-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 - ---------- Original Message ----------- From: Jorge Arellano Cid <jcid@dillo.org> To: Gavin Henry <ghenry@fedoranews.org> Cc: Dillo mailing list <dillo-dev@auriga.wearlab.de> Sent: Tue, 24 Feb 2004 13:22:38 -0300 (CLST) Subject: Re: Upcoming review.
[list: this was originally a personal answer to Gavin, but as it has general interest information I'm CC to dillo-dev. It's about a browser comparison article. ]
Gavin,
[...] Thanks, I saw a few of these. I will check out the wording etc. Mine might not be so in depth, more of a general features thing. But there will be figures ie load times etc. which I am sure yours will win.
:)
Know of any monster sites, that would be a good benchmark for the browsers. I have ADSL, so banwidth shouldn't be an issue.
There're some interesting tests to be done. Which one you choose depends on the time you have, and on what you want to test for.
For instance, IMHO, the common "web experience" has four important factors:
So far I have tested the browsers on slashdot, and bbc.co.uk and a few others. They all seem to wait until some pictures arrive until rendering anything. I haven't time these yet. Dillo, displays text immediately, but has some difficulty with CSS. For instance fedoranews.org looks bad :-) Are you familiar with http://wwww.udcast.com/ whcih runs freebsd and has customised apache etc. I thought maybe you have done something like this. As my day job www.invsat.com we had a demo from them and they explained the priciple of http precaching. Instead of requesting 4 images then waiting, it requests all images at once, as this then reduces the latency across a satellite link. Is this how your browser works? (*I haven't look at any code as of yet ;-) )
* Network wait time
* Rendering wait time
* Time to start seeing content - streamed rendering
* Site usability
These will be what I base the benchmarks on.
These are key factors; for instance the same site may be unusable depending on whether you're on a dialup or broad band. The same is true for rendering time (influenced by CPU power and available memory); you may end going to some site only when you're sitting at a powerful workstation.
I don't have access to dial-up, but I have a celeron 400 and a athlon xp 2000 to test on.
The time to start seeing content is also important. If it takes too long, it may exceed the user's patience (there're studies about this). For instance, if a browser needs the whole table to start rendering, some table-based sites will be exceedingly annoying to visit (unless your band-width can mitigate this).
Dillo is very fast on this.
The site usability is another key factor. For instance if it's designed for a certain browser, it may be impossible to use with another.
Alot seem broken. I will properly read the review site you posted so I can see what result they found.
Now, getting back to the test suggestions you asked, these points can be isolated.
* Network wait time:
Get to a site with multiple images, ideally with some coming from other sites. I'm sure you will find a better example for an english speaking audience, but this link illustrates the idea:
Alot of pics n this one ;)
* Rendering wait time
Very simple, load a semi complex page (like slashdot with comments --a 500KB one), or a large one (as the mysql manual -- I have one which is more than two Megabytes long).
Press back, the forward. (you can have some coffee :)
Slashdot works perfect. What do you define as a compliant site? All done in CSS? no java script or flash? xhtml or html? Oops, meant for usability section.
* Time to start seeing content - streamed rendering
Get to a table-based semi complex page (300Kb-600Kb) and measure the time between asking for the URL and when you can start reading.
* Site usability
Well, this depends on whether the page respects standards, how broken the site implementation is, the browser's support for the technologies involved, user preferences (javascript may be disabled, same for cookies, a JVM may not be present, same for flash, etc).
Got it.
--
Now that's for having some numbers to show inside a table for people with above the average knowledge about browsers :-)
(very interesting, but not massive).
Nope, but very interesting. I will need a quick hand on the stop watch :-)
Simple usability experience can be explained to less technical people:
For instance, take dillo, and dig for something using google. You'll find that the time you use to make different queries and to check for alternative links until you find what you look for is better than with almost anything you've used before.
Noticed that.
The same is true for browsing local documentation (all of those html files under the /usr/doc or /usr/share/doc directories). This happens because the combined rendering speed and low download time (a filesystem) let you move very quickly, back and forward, make text searches inside the pages, go to another link, saving you lots of time.
Agreed.
Going with dillo to any web site is different, if it respects standards (ans so renders OK) its great, but if not, you'll have to resort to a bigger browser.
Agreed. :-(
The other important points to consider is to test with different band widths and CPU power. You'll barely notice how fast dillo is on a 2.2 Ghz machine, and if you only test on broad band you'll never know that it's possible to have a good browsing experience with a simple dialup.
That's it.
Cheers Jorge.-
- ------- End of Original Message ------- Thanks Jorge, I really appreciate your time and expertise. I think these will be used as the basis for browser benchmarks, stealling the reasoning you gave for the introductions :-) I will give you a preview of it as it starts to resemble something readable. Thanks again. P.S> I posted this to the list from my company account too. - -- Kind Regards, Gavin Henry. Director. Open Source. Open Solutions. http://www.suretecsystems.com -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.2.4 (GNU/Linux) iD8DBQFAO9X0eWseh9tzvqgRAr/uAJ9piEKRTm8E6Ndqi71Oaecg4kcL9gCfYdma x2S++i7TSEVnL4W8Fmu6J9k= =cwPk -----END PGP SIGNATURE-----