February 2008 - Dillo-dev - lists.mailman3.com

[patch] optimize redraw after resize for textblocks

by jcid＠dillo.org

Hi, On Mon, Feb 18, 2008 at 05:50:43PM +0100, Johannes Hofmann wrote: > Hello, > > here comes my attempt to avoid unnecessary redraws > caused by images that are not visible. > The first patch makes some minor optimizations to the drawing code > and disables the use of the asap parameter for better testing. > The second patch replaces the general queueDrawTotal() in > Layout::resizeIdle () with more specific redraw calls in > widgets that can be topLevel. > Currently only Textblock is optimized. > The idea is that resizing child widgets in a textblock don't affect > the layout of the textblock above the resizing widget. So only the > area below needs to be redrawn. Excellent! Committed. (Of course this is a work that is in state of flux, but I preferred to have this basis in CVS). BTW, this explanation: "The idea is that resizing child widgets in a textblock don't affect the layout of the textblock above the resizing widget." should make its way, as a comment, into the code. > I think that does not hold for tables, but perhaps other > optimizations are possible here? Ideas anyone? Yes, after my work on tables, I think if the column sizes don't change, the rule could be the same used for the textblock. Please excuse me for my lack of time the past week and these days, I'll answer and work as time permits... -- Cheers Jorge.-

Feb. 21, 2008

[patch] optimize redraw after resize for textblocks

by Johannes.Hofmann＠gmx.de

Hi, On Thu, Feb 21, 2008 at 04:57:29AM +0000, place wrote: > Hi Johannes, > > I finally got around to applying this today... > Are you seeing any problems with text highlighting? > > If I repeat searches so that the page scrolls some -- but not far enough > for the previous instance to scroll off screen -- the previous instance > stays highlighted and the current instance isn't highlighted. > > It's entirely possible that I screwed something up, but when I > diffed my trees, I didn't notice anything wrong... No, I'm seeing this too now. I will try to fix it. Thanks for testing, Johannes

Feb. 21, 2008

[patch] optimize redraw after resize for textblocks

by Johannes.Hofmann＠gmx.de

Hello, here comes my attempt to avoid unnecessary redraws caused by images that are not visible. The first patch makes some minor optimizations to the drawing code and disables the use of the asap parameter for better testing. The second patch replaces the general queueDrawTotal() in Layout::resizeIdle () with more specific redraw calls in widgets that can be topLevel. Currently only Textblock is optimized. The idea is that resizing child widgets in a textblock don't affect the layout of the textblock above the resizing widget. So only the area below needs to be redrawn. I think that does not hold for tables, but perhaps other optimizations are possible here? Ideas anyone? The effect is visible e.g. on http://chlamydia.fs.ei.tum.de/pub/DragonFly/packages/stable/DragonFly-1.10.… but not on table based pages. Cheers, Johannes

Feb. 18, 2008

Dillo screenshot on my ipaq

by akemnade＠tzi.de

Hi, On Sat, 9 Feb 2008 12:57:33 -0300 Jorge Arellano Cid <jcid(a)dillo.org> wrote: > Please excuse my lack of knowledge on the iPAQ. Whad does it > involve to get dillo2 running on it? > You need somehow a build environment for it. mainly it is about compiling binutils and gcc with --target=arm-linux and installing the familiar packages (including dev-packages) for the required libraries into the search path of the compiler. And a pkg-config with the correct paths compiled in is also helpful (name it arm-linux-pkg-config) And then it is time to compile fltk, dw and dillo with ./configure --host=arm-linux and pay attention that it uses correct paths for every library. And then it is the usual make && make DESTDIR=/somewhere/ install for dillo2. In /somewhere/ you can build a tarball of the installed files and unpack it on the ipaq. I have not looked into package creation yet, but the packet format looks the same as for debian just with another suffix (an ar archive which contains a data.tar.gz (with the real data, a control.tar.gz which some control information like dependencies and install scripts) and another file used as a marker, older versions of familiar seem to bind the three files together as a gzip'ed tarfile). But I'll try to find something out about it. Greetings Andreas Kemnade

Feb. 18, 2008

[experimental patch] excessive redraws (again)

by Johannes.Hofmann＠gmx.de

Hi Jorge, On Wed, Feb 13, 2008 at 01:51:50PM -0300, Jorge Arellano Cid wrote: -- snip -- > > Bottom line: > > Main problem: updates of out-of-screen images > produce a full redraw. > (same for large textblocks) > > If we can solve this, the rest may become insignificant! Exactly. Those redraws are unnecessary and should be avoided. > > Please feel free to experiment, propose alternatives, or > implement a better approach that can be committed ASAP! :-) I will try to come up with a fix, but it may take a while since I will be skiing this weekend :-) Independent from that, I'm using my last patch regarding the redraws for quite a while now and it works pretty well here. Doesn't it make dillo2 much more useable for you, or do you see negative effects with it? Cheers, Johannes

Feb. 14, 2008

[experimental patch] excessive redraws (again)

by jcid＠dillo.org

On Mon, Feb 11, 2008 at 06:52:42AM +0100, Johannes Hofmann wrote: > Hi Jorge, > > On Sun, Feb 10, 2008 at 03:43:10PM -0300, Jorge Arellano Cid wrote: > > On Fri, Feb 08, 2008 at 02:42:23PM -0300, Jorge Arellano Cid wrote: > > > Hi Johannes, > > > > > > > > > [...] > > > > > > * Of course we still should reconsider each call to queueDrawTotal() > > > > > > or queueResize() and verify whether it is really necessary. > > > > > > However I think we should favor correctness over speed. That > > > > > > means, whenever the layout might have changed, we must call > > > > > > queueResize(). > > > > > > > > > > Sure. The patch is not complete. After adding the missing > > > > > flushes it should work OK. And refresh_delay would help to set > > > > > the desired behaviour. > > > > > > I just committed some missing flushes so now the code updates > > > the screen ASAP when finishing a bare image URL, a plain text > > > page, and after the viewport resizes. > > > > > > Basically it behaves as "update on finish" (except that images > > > still queue a drawTotal so they update the whole canvas while > > > loading). > > > > > > Adding a tiemout to update periodically is easy, and thus the > > > model would be more or less complete. Although it's simple (I've > > > done it in my tree for testing), the CVS "as is" is the best to > > > spot the bugs. > > > > OK, I committed an experimental patch that implememts the > > "feel" of the idea (i.e. a draw/flush scheme with a refresh rate) > > > > The rate can be set in fltkviewbase.cc:48. The default value is > > 2 seconds (the idea is to make it a preference). > > > > There's still a lot to review and fix. In fact these are calls > > to drawTotal, and most of them are image updates that should be > > ignored when the image is out of the screen and doesn't resize > > the parent widget. > > > > If refresh rate is set to zero, behaviour gets like before the > > patch (storming updates). If it's set to a high value behaviour > > gets like a raw draw/flush scheme. > > > > Interesting to see that altough many unnecessary update calls > > remain in the code, flickering is reduced a lot, and it starts to > > feel comfortable without double buffer. > > > > > I'll keep on reviewing and expecting your work&comments. > > > > Comments, patches, fixes are welcomed. > > > Yes, that's the way to go I think. Which way? > The decision of when to draw should be done in a central function. > Whether based on a timeout like in your current implementation or some > other method is used to decide when to draw needs to be seen. Yeah, a central function looks like a good idea. (see my previous email for some things this function should consider). > As stated before I would even treat all redraw requests equally and > ignore the asap parameter. Could be. If it tackles the problems explained in the former email. -- Cheers Jorge.-

Feb. 13, 2008

[experimental patch] excessive redraws (again)

by jcid＠dillo.org

Hi Johannes, Please excuse me for my scattered comments these days. I'm travelling visiting some relatives. On Mon, Feb 11, 2008 at 06:44:48AM +0100, Johannes Hofmann wrote: > Hi Jorge, > > On Thu, Feb 07, 2008 at 06:32:55PM -0300, Jorge Arellano Cid wrote: > > On Thu, Feb 07, 2008 at 09:50:00PM +0100, Johannes Hofmann wrote: > > > Hi, > > > > > > On Thu, Feb 07, 2008 at 05:23:40PM -0300, Jorge Arellano Cid wrote: > > > > > > - snip - > > > > > > > > > > > > > If I understand this correctly, the patch now is equivalent to > > > > > removing the calls to queueDrawTotal(), where asap == false, right? > > > > > > > > Right. > > > > > > > > But the idea is to queue when asap == false, and to set a delayed > > > > draw that is user adjustable in seconds (e.g. 0, 0.5, 1, 3, ...). > > > > > > Ok. I think we mostly agree on what needs to be done. My only > > > concern with your aproach is that I wonder why the new asap > > > parameter is needed: > > > When to call with asap == true and when to call it with asap == false? > > > > As a synonym for flush. > > Ok, but how do you know at widget level whether a flush is good or > whether it's better to queue the redraw? At widget level is not easy, and most probably can't be done in the general case. Asap is used as a way to solve these problems: With the patch that ignored redraws with asap=false, asap=true solved the problem of ensuring images were actually drawn sometime (fully updated). The same for main page: asap=true was requested when the network transfer was done, asserting that the main content was updated to the last bit. With the current patch, redraws with (asap==false) are not ignored but queued with a timeout (2 seconds); this ensures images and main pages are drawn. But in this case (asap==true) ensures you don't have to wait the timeout for fast pages. e.g. local files. This scheme allows for minimal CPU usage (big timeout) or fast updates (low or no timeout). If both can be accomplished from a central function without using the asap parameter; great. > > > > For instance when and image finishes loading we can call with > > asap=true and if we want it to display incrementally, we can > > asap=true every update. > > This is a great example. Think about an html image gallery. A > partial update of the main image is much more important and should > be rendered immediately than a 1x1 pixel spacer that had been loaded > completely. > > My point is, that we can't decide at widget level whether the redraw > should be done now or later. (as explained above). Now, with images, I beleive the main point is to eliminate uneccessary updates (i.e. flickering and wasted CPU time). For instance, I took place's large table (generated from C), and added an <img src='file:/tmp/ball.gif> to every form. That way I had a large page with lots of instances of the same image. Then got the page and image, served through a local cgi-program that can set the transfer speed. Test result: updates of out-of-screen images produced a full redraw. I believe this is the main source of unnecessary redraws. If the image is out-of-screen and it doesn't resize the parent widget, no full resize/redraw is needed. For instance, with the gallery example above, if the small image is updated and the table holding it is not forced a resize when not necessary, the update could be welcomed. Caveat Note: the current implemetation really implements ASAP. This is, the queue function calls redraw directly instead of queuing the redraw for the next idle call (which would be much better). Bottom line: Main problem: updates of out-of-screen images produce a full redraw. (same for large textblocks) If we can solve this, the rest may become insignificant! Please feel free to experiment, propose alternatives, or implement a better approach that can be committed ASAP! :-) -- Cheers Jorge.-

Feb. 13, 2008

[experimental patch] excessive redraws (again)

by Johannes.Hofmann＠gmx.de

Hi Jorge, On Sun, Feb 10, 2008 at 03:43:10PM -0300, Jorge Arellano Cid wrote: > On Fri, Feb 08, 2008 at 02:42:23PM -0300, Jorge Arellano Cid wrote: > > Hi Johannes, > > > > > > > [...] > > > > > * Of course we still should reconsider each call to queueDrawTotal() > > > > > or queueResize() and verify whether it is really necessary. > > > > > However I think we should favor correctness over speed. That > > > > > means, whenever the layout might have changed, we must call > > > > > queueResize(). > > > > > > > > Sure. The patch is not complete. After adding the missing > > > > flushes it should work OK. And refresh_delay would help to set > > > > the desired behaviour. > > > > I just committed some missing flushes so now the code updates > > the screen ASAP when finishing a bare image URL, a plain text > > page, and after the viewport resizes. > > > > Basically it behaves as "update on finish" (except that images > > still queue a drawTotal so they update the whole canvas while > > loading). > > > > Adding a tiemout to update periodically is easy, and thus the > > model would be more or less complete. Although it's simple (I've > > done it in my tree for testing), the CVS "as is" is the best to > > spot the bugs. > > OK, I committed an experimental patch that implememts the > "feel" of the idea (i.e. a draw/flush scheme with a refresh rate) > > The rate can be set in fltkviewbase.cc:48. The default value is > 2 seconds (the idea is to make it a preference). > > There's still a lot to review and fix. In fact these are calls > to drawTotal, and most of them are image updates that should be > ignored when the image is out of the screen and doesn't resize > the parent widget. > > If refresh rate is set to zero, behaviour gets like before the > patch (storming updates). If it's set to a high value behaviour > gets like a raw draw/flush scheme. > > Interesting to see that altough many unnecessary update calls > remain in the code, flickering is reduced a lot, and it starts to > feel comfortable without double buffer. > > > I'll keep on reviewing and expecting your work&comments. > > Comments, patches, fixes are welcomed. Yes, that's the way to go I think. The decision of when to draw should be done in a central function. Whether based on a timeout like in your current implementation or some other method is used to decide when to draw needs to be seen. As stated before I would even treat all redraw requests equally and ignore the asap parameter. Cheers, Johannes > > -- > Cheers > Jorge.- > > _______________________________________________ > Dillo-dev mailing list > Dillo-dev(a)dillo.org > http://lists.auriga.wearlab.de/cgi-bin/mailman/listinfo/dillo-dev

Feb. 11, 2008

[experimental patch] excessive redraws (again)

by Johannes.Hofmann＠gmx.de

Hi Jorge, On Thu, Feb 07, 2008 at 06:32:55PM -0300, Jorge Arellano Cid wrote: > On Thu, Feb 07, 2008 at 09:50:00PM +0100, Johannes Hofmann wrote: > > Hi, > > > > On Thu, Feb 07, 2008 at 05:23:40PM -0300, Jorge Arellano Cid wrote: > > > > - snip - > > > > > > > > > > If I understand this correctly, the patch now is equivalent to > > > > removing the calls to queueDrawTotal(), where asap == false, right? > > > > > > Right. > > > > > > But the idea is to queue when asap == false, and to set a delayed > > > draw that is user adjustable in seconds (e.g. 0, 0.5, 1, 3, ...). > > > > Ok. I think we mostly agree on what needs to be done. My only > > concern with your aproach is that I wonder why the new asap > > parameter is needed: > > When to call with asap == true and when to call it with asap == false? > > As a synonym for flush. Ok, but how do you know at widget level whether a flush is good or whether it's better to queue the redraw? > > For instance when and image finishes loading we can call with > asap=true and if we want it to display incrementally, we can > asap=true every update. This is a great example. Think about an html image gallery. A partial update of the main image is much more important and should be rendered immediately than a 1x1 pixel spacer that had been loaded completely. My point is, that we can't decide at widget level whether the redraw should be done now or later. > > asap=false can mean: > "this operation is needed but can be delayed". > > > > > > * Frequent redraws are good if they update the visible content. > > > > E.g. when loading a page over a slow line. > > > > Immediate feedback to the user is a great feature of dillo. > > > > The screen flickering can be avoided with some double buffer > > > > mechanism. > > > > > > Choosing refresh_delay=0 would give immediate feedback. > > > > > > refresh_delay=3 could yield low CPU usage and very good > > > performance. > > > > Yes, that's exactly what my patch does. It delays the actual > > drawing operation if there is other things to do (e.g. new data is > > coming in). > > Yes, both patches attack the same problem after all. > > Once the code is cleaned, we can choose the one that fits > better. I liked the flush/asap approach because it was putting > unnecesary calls under the spotlight. Yes I also commented out redraw() operations in various places for testing, but it's really difficult to find places where they are completely unnecessary. > > It was also faster in some tests. Although this may change > after the cleanup. > > > > > > [...] > > > > * It would be nice, if we could decide whether a resizing widget > > > > affects the layout that is currently visible, so that we could > > > > avoid redrawing in this case. This would avoid redrawing when > > > > loading very long pages as the DragonFly package list. > > > > But I don't think this is easy. > > > > > > Back in 2005 we needed to test the prototype quickly, so it was > > > reasonable to simply add, for instance, a queuedrawTotal() call > > > when only a queuedraw() was needed and to postpone clipping until > > > the basics were working. > > > > > > I believe this is what is asking for a review now. > > > > Yes sure. There might be places where we can replace the > > queueDrawTotal(). Let's go through the code with this in mind. > > OK. > > I also have yet to understand how it all fits together... > (allocate/resize/draw) > > > > > Also we should agree on what we actually want to optimize. > > > > I don't think CPU usage or number of redraws are enough. > > > > Instead dillo should be usable and "feel fast" on fast and > > > > slow or loaded systems (if CPU is available, why not use it?). > > > > > > I believe we can have it all! (as explained above). > > > > Same here :-) > > Good. > Cheers, Johannes

Feb. 11, 2008

[experimental patch] excessive redraws (again)

by jcid＠dillo.org

On Sun, Feb 10, 2008 at 09:08:34PM +0000, place wrote: > Jorge wrote: > > OK, I committed an experimental patch that implememts the > > "feel" of the idea (i.e. a draw/flush scheme with a refresh rate) > > > It appears that the new code does not like closed bws: > > ... > a_UIcmd_close_bw > FltkViewBase::queueDrawTotal asap=0 > FltkViewBase::drawTotal > > Program received signal SIGSEGV, Segmentation fault. Oh, yes, a missing timeout function removal in the destructor. Patch committed. -- Cheers Jorge.-

Feb. 11, 2008