- Dillo-dev - lists.mailman3.com

[patch] partial redraws - updated

by jcid＠dillo.org

Hi, On Tue, Dec 04, 2007 at 02:42:32PM +0100, Johannes Hofmann wrote: > Hi Jorge, > > > > > Committed! > > > > > > Thanks. Attached is another patch that has some improvements to that > > > code: > > > > Excellent. > > > > Committed. > > until now, just the Changlog has been commited, right? Right, my mistake. :-P Committed again. > > If not, even when I'm not an expert in dw2, I'd prefer to > > push forward development in that area and to commit what looks > > OK. Sebastian will always have the opportunity to comment/fix > > later. > > Regarding the scrollbars there is something fishy in the current > code that needs fixing: The scrollbars are created in the > FltkViewport constructor and they are drawn on the screen area > belonging to FltkViewport. However from fltk point of view they are > children of TopGroup. Yes, we know there's something fishy there because while in Germany we discovered scrollbars worked without the line that was supposedly drawing them! :-) > I think this is the reason why fltk replace() does not work > properly. > > However, my proposed fix is really quite radical and I would want to > wait for a comment from Sebastian before we head into that > direction. OK. > > As a matter of fact I'm working of improving table rendering > > now, and I already have some code that works. It's a complex area > > that needs some work but I hope to commit a patch this week. > > > > BTW, did you receive comments on the patch that lowered CPU > > consumption when gliding the mouse over pages full of links? > > No, but the change is not that dramatic, so I think it can be > applied. Do you need a patch against current cvs? Committed. -- Cheers Jorge.-

Dec. 4, 2007

BUG: CCC corrupts memory when the Content-Type is wrong

by onepoint＠starurchin.org

Heh, I sent the valgrind logs separately but they were so large they were held for moderation. This is just the summarised version. It lists the freed blocks that were accessed and the sequence of invalid accesses. It's clear that the CCC is accessing pointers after freeing them. Jeremy Henty Freed blocks: [1]: 0x4AB7910:(IOData_t *), freed by a_IO_ccc (IO.c:385) [2]: 0x4AB78C0:(ChainLink *Info), freed by a_IO_ccc (IO.c:386) [3]: 0x4AB5768:(ChainLink *Info), freed by a_Dpi_ccc (dpi.c:696) [4]: 0x4AB5718:(ChainLink *Info), freed by a_Capi_ccc (capi.c:536) [5]: 0x4AACE10:(capi_conn_t *), freed by a_Capi_ccc (capi.c:535) [6]: 0x4AACE68:(DilloUrl *), freed by a_Capi_ccc (capi.c:535) [7]: 0x4AB57B8:(dpi_conn_t *), freed by a_Dpi_ccc (dpi.c:695) [8]: 0x4AB5818:(Dstr *), freed by a_Dpi_ccc (dpi.c:695) [9]: 0x4AB5858:(Dstr_char_t *), freed by a_Dpi_ccc (dpi.c:672) [10]: 0x4AB7960:(Dstr *ds), freed by a_IO_ccc (IO.c:385) [11]: 0x4AB79A0:(Dstr_char_t *), freed by a_IO_ccc (IO.c:385) [1] read at IO_read (IO.c:194) [2] read at a_IO_ccc (IO.c:402) (many times) [3] read at a_IO_ccc (IO.c:402) (many times) [4] read at a_Capi_ccc (capi.c:569) [5] write at a_Capi_ccc (capi.c:570) [5] read at a_Capi_ccc (capi.c:572) [6] read at a_Url_cmp (url.c:442) [5] read at a_Capi_ccc (capi.c:574) [5] read at Capi_conn_unref (capi.c:132) (twice) [4] freed by a_Capi_ccc (capi.c:579) [3] read at a_Dpi_ccc (dpi.c:672) [7] read at Dpi_conn_free (dpi.c:124) [7] read at Dpi_conn_free (dpi.c:125) [8] read at dStr_free (dlib.c:291) [8] read at dStr_free (dlib.c:292) [9] freed by a_Dpi_ccc (dpi.c:672) [8] freed by a_Dpi_ccc (dpi.c:672) [7] freed by a_Dpi_ccc (dpi.c:672) [3] freed by a_Dpi_ccc (dpi.c:673) [1] read at IO_read (IO.c:194) (many times) [10] read at dStr_free (dlib.c:291) [1] read at dStr_free (dlib.c:292) [11] freed by a_IO_ccc (IO.c:404) [10] freed by a_IO_ccc (IO.c:404) [1] freed by a_IO_ccc (IO.c:404) [2] freed by a_IO_ccc (IO.c:405)

Dec. 4, 2007

BUG: CCC corrupts memory when the Content-Type is wrong

by onepoint＠starurchin.org

I am hoping that someone who understands Dillo's CCC better than I can point me in the right direction and save me some time debugging this. Dillo almost always crashes if the HTML contains the stumbleupon.com favicon link, ie.'<img src="http://www.stumbleupon.com/favicon.ico">'. (This is very annoying as it makes Dillo unusable for one of my favourite blogs.) If it doesn't crash right away then clicking Reload crashes it. Examining core dumps with gdb suggests that memory is being corrupted, and running dillo under valgrind shows that the CCC functions are reading, writing and freeing already freed memory. (Details attached.) A local HTTP server triggers the bug when it server returns a Content-Type of "text/plain; charset=iso-8859-1". If I change it to "image/x-icon" there is no corruption. Accessing the image directly via a "file:" URL does not trigger the bug. (Strangely, using a local HTTP server does not hit the bug until I open a second window on the page, although sometimes it crashes first time.) I'm attaching a summary of the invalid memory accesses that valgrind reported, and the entire valgrind log (which includes stack traces). Any suggestions for where I should start instrumenting the CCC to find out why it is prematurely freeing pointers? Jeremy Henty

Dec. 4, 2007

[patch] partial redraws - updated

by Johannes.Hofmann＠gmx.de

Hi Jorge, On Tue, Dec 04, 2007 at 10:05:25AM -0300, Jorge Arellano Cid wrote: > Hi Johannes, > > On Tue, Dec 04, 2007 at 11:03:01AM +0100, Johannes Hofmann wrote: > > On Mon, Dec 03, 2007 at 02:00:07PM -0300, Jorge Arellano Cid wrote: > > > On Sun, Dec 02, 2007 at 01:53:14PM +0100, Johannes Hofmann wrote: > > > > Hello, > > > > > > > > this patch fixes the problem pointed out by Sebastian regarding > > > > partial redraws and scrolling interference. > > > > It adds a new Region class that is implemented similarily > > > > as in dillo1 as a set of rectangles not containing each other. > > > > The conversion from canvas to view coordinates is now done at > > > > draw-time. > > > > > > Committed! > > > > Thanks. Attached is another patch that has some improvements to that > > code: > > Excellent. > > Committed. until now, just the Changlog has been commited, right? > > > * The case that multiple rectangles can be exactly combined to a larger > > one is quite likely (other than the comment in dillo1 suggests). > > It happens all the time, e.g. when an image is loaded piece by piece. > > The region code is improved to take advantage of this. > > ok. > > > * A minor bug also present in the dillo1 code is fixed: If a > > rectangle existing already in the region is contained in a newly > > added rectangle, we must not stop the loop. The new rectangle may > > contain other rectangles as well! > > ok. > > > * The actual drawing of a region now checks, whether a rectangle is > > actually visible at the moment. > > Does this help to reduce flickering? I don't think so, it just shortcuts drawing operations that are not visible anyway. > > > * The background is now cleared properly when doing a partial > > redraw. This fixes some screen corruption occuring when selecting / > > deselecting text. > > ok. > > Please excuse me for not having yet the time to review the > patch for the scrolling bars. Has Sebastian commented it to you? No, not yet. > > If not, even when I'm not an expert in dw2, I'd prefer to > push forward development in that area and to commit what looks > OK. Sebastian will always have the opportunity to comment/fix > later. Regarding the scrollbars there is something fishy in the current code that needs fixing: The scrollbars are created in the FltkViewport constructor and they are drawn on the screen area belonging to FltkViewport. However from fltk point of view they are children of TopGroup. I think this is the reason why fltk replace() does not work properly. However, my proposed fix is really quite radical and I would want to wait for a comment from Sebastian before we head into that direction. > > As a matter of fact I'm working of improving table rendering > now, and I already have some code that works. It's a complex area > that needs some work but I hope to commit a patch this week. > > BTW, did you receive comments on the patch that lowered CPU > consumption when gliding the mouse over pages full of links? No, but the change is not that dramatic, so I think it can be applied. Do you need a patch against current cvs? Cheers, Johannes > > -- > Cheers > Jorge.- > > _______________________________________________ > Dillo-dev mailing list > Dillo-dev(a)dillo.org > http://lists.auriga.wearlab.de/cgi-bin/mailman/listinfo/dillo-dev

Dec. 4, 2007

[patch] partial redraws - updated

by jcid＠dillo.org

Hi Johannes, On Tue, Dec 04, 2007 at 11:03:01AM +0100, Johannes Hofmann wrote: > On Mon, Dec 03, 2007 at 02:00:07PM -0300, Jorge Arellano Cid wrote: > > On Sun, Dec 02, 2007 at 01:53:14PM +0100, Johannes Hofmann wrote: > > > Hello, > > > > > > this patch fixes the problem pointed out by Sebastian regarding > > > partial redraws and scrolling interference. > > > It adds a new Region class that is implemented similarily > > > as in dillo1 as a set of rectangles not containing each other. > > > The conversion from canvas to view coordinates is now done at > > > draw-time. > > > > Committed! > > Thanks. Attached is another patch that has some improvements to that > code: Excellent. Committed. > * The case that multiple rectangles can be exactly combined to a larger > one is quite likely (other than the comment in dillo1 suggests). > It happens all the time, e.g. when an image is loaded piece by piece. > The region code is improved to take advantage of this. ok. > * A minor bug also present in the dillo1 code is fixed: If a > rectangle existing already in the region is contained in a newly > added rectangle, we must not stop the loop. The new rectangle may > contain other rectangles as well! ok. > * The actual drawing of a region now checks, whether a rectangle is > actually visible at the moment. Does this help to reduce flickering? > * The background is now cleared properly when doing a partial > redraw. This fixes some screen corruption occuring when selecting / > deselecting text. ok. Please excuse me for not having yet the time to review the patch for the scrolling bars. Has Sebastian commented it to you? If not, even when I'm not an expert in dw2, I'd prefer to push forward development in that area and to commit what looks OK. Sebastian will always have the opportunity to comment/fix later. As a matter of fact I'm working of improving table rendering now, and I already have some code that works. It's a complex area that needs some work but I hope to commit a patch this week. BTW, did you receive comments on the patch that lowered CPU consumption when gliding the mouse over pages full of links? -- Cheers Jorge.-

Dec. 4, 2007

[patch] partial redraws - updated

by Johannes.Hofmann＠gmx.de

On Mon, Dec 03, 2007 at 02:00:07PM -0300, Jorge Arellano Cid wrote: > On Sun, Dec 02, 2007 at 01:53:14PM +0100, Johannes Hofmann wrote: > > Hello, > > > > this patch fixes the problem pointed out by Sebastian regarding > > partial redraws and scrolling interference. > > It adds a new Region class that is implemented similarily > > as in dillo1 as a set of rectangles not containing each other. > > The conversion from canvas to view coordinates is now done at > > draw-time. > > Committed! Thanks. Attached is another patch that has some improvements to that code: * The case that multiple rectangles can be exactly combined to a larger one is quite likely (other than the comment in dillo1 suggests). It happens all the time, e.g. when an image is loaded piece by piece. The region code is improved to take advantage of this. * A minor bug also present in the dillo1 code is fixed: If a rectangle existing already in the region is contained in a newly added rectangle, we must not stop the loop. The new rectangle may contain other rectangles as well! * The actual drawing of a region now checks, whether a rectangle is actually visible at the moment. * The background is now cleared properly when doing a partial redraw. This fixes some screen corruption occuring when selecting / deselecting text. Cheers, Johannes > > > PS: The code did not get as complex as I initially thought > > it would :-) > > Great. > > -- > Cheers > Jorge.- > > _______________________________________________ > Dillo-dev mailing list > Dillo-dev(a)dillo.org > http://lists.auriga.wearlab.de/cgi-bin/mailman/listinfo/dillo-dev

Dec. 4, 2007

[patch] partial redraws - updated

by jcid＠dillo.org

On Sun, Dec 02, 2007 at 01:53:14PM +0100, Johannes Hofmann wrote: > Hello, > > this patch fixes the problem pointed out by Sebastian regarding > partial redraws and scrolling interference. > It adds a new Region class that is implemented similarily > as in dillo1 as a set of rectangles not containing each other. > The conversion from canvas to view coordinates is now done at > draw-time. Committed! > PS: The code did not get as complex as I initially thought > it would :-) Great. -- Cheers Jorge.-

Dec. 3, 2007

Re: patch: a _minuscule_ amount of cleaning up the header parsing code

by jcid＠dillo.org

On Thu, Nov 29, 2007 at 03:08:12PM +0000, place wrote: > No change in behavior is intended. > Yes, that code is getting hard to understand. After a review, I wondered why Cache_parse_header() is dealing with the message body, when it should only parse the header, and why is it getting the (buf, bufsize) pair when it has the content in entry->Header. It looks that a cleaner way would be something like: (not tested, just pseudo-code) if (!(entry->Flags & CA_GotHeader)) { while ((len = Cache_get_header(entry, buf + start, buf_size - start))) { /* Let's scan, allocate, and set things according to header info */ Cache_parse_header(entry); if (entry->Flags & CA_GotHeader) { start += len; } else // Let the flow continue downward so the remaining // of the buffer is processed } return; } and to get rid of the: dbuf = a_Decode_process(entry->TransferDecoder, dbuf); dbuf = a_Decode_process(entry->ContentDecoder, dbuf); lines inside Cache_parse_header(). Please give it a try. -- Cheers Jorge.-

Dec. 3, 2007

[patch] partial redraws - updated

by Johannes.Hofmann＠gmx.de

Hello, this patch fixes the problem pointed out by Sebastian regarding partial redraws and scrolling interference. It adds a new Region class that is implemented similarily as in dillo1 as a set of rectangles not containing each other. The conversion from canvas to view coordinates is now done at draw-time. Regards, Johannes PS: The code did not get as complex as I initially thought it would :-)

Dec. 2, 2007

Re: charset conversion issues

by place＠gobigwest.com

Jorge wrote: > > - Reach the meta tag and undo/redo within html.cc. > > Somewhat fragile. > > Whatever I might come up with, some html out there would surely find a way > > to outsmart me. > > This is the one I like most at first sight. > > Considering the charset can be given by HTTP or a META element: > > We can assume ASCII in the html text until the HEAD element is > closed. If there's a charset in the META, then the decoder can be > switched from null to the specified one. > > This approach has the advantage of working both when the > charset comes via HTTP or META (<HEAD> content is ASCII). > > We can even add a text buffer for the HEAD element and append > it to the whole HTML content if the offset is hard to set for the > new decoder. > > Do the problems you found apply to this scheme too? My original code worked a bit like this. It would set a flag to make Html_write_raw() quit early and go back up to Html_write() for re-decoding. (It would just restart from the beginning, though, and I would ignore the error messages about multiple heads and so on.) - At least the title tag has to be called again. - Maybe a future dillo that does things with javascript has already seen some and done things with it -- possibly involving literal strings -- by the time we reach meta. I don't know javascript, though, so I don't know whether that's an actual concern. I'm not quite sure what you're saying about the text buffer, though...

Nov. 28, 2007