- Dillo-dev - lists.mailman3.com

Re: HTTPS Proxy Support

by Rodrigo Arias

Hi, On Wed, Jun 26, 2024 at 08:52:37AM +1000, Kevin Koster wrote: >Rodrigo Arias <rodarima-Re5JQEeQqe8AvxtiuMwx3w(a)public.gmane.org> wrote: >>>Also I don't think that 'https_endpoint' actually needs to be set >>>from an environment variable, just a dillorc setting would do. >> >> I also think is good if it is only a dillorc option. I'm not sure if I >> like more something like: >> >> https_proxy=http://localhost:1234 > >Ahh, that's what I was doing wrong with Lynx! I didn't include the >"http://" part (which Wget doesn't require, though I see now that >the Wget manual does say it should be set to a URL, not a >hostname). I really do make a meal of this proxy stuff. Yeah, it is a bit confusing :-) >> # Setting this to TRUE sends HTTPS traffic unencrypted to the proxy. >> # Don't change unless you know what you are doing. >> #https_proxy_use_http=FALSE (default) >> https_proxy_use_http=TRUE >> >> For normal uses, setting the https proxy with https_proxy would make >> more sense than using http_proxy for HTTPS traffic anyway. > >If the 'http_proxy' behaviour changes to only apply to HTTP like >in other software, everyone using the 'http_proxy' setting will >have to change their configuration to set 'https_proxy' as well. >That'd be an annoying behaviour change. > >But otherwise using the setting name 'https_proxy' makes it unclear >how that relates to the 'http_proxy' setting that applies to both >HTTP and HTTPS. Sadly, there is no standard (AFAIK) that specifies how to use those variables, but most software tools seem to use them in a more or less coherent way. And I think new users would expect it to follow the same usage than curl, wget or other browsers. It doesn't have to be annoying, we can slowly deprecate the current mechanism by displaying a warning when only http_proxy is set that https_proxy should be set too, and change the behavior in a new release that is clearly documented in the release notes. >If I set: > >http_proxy=http://localhost:1234 >https_proxy=http://localhost:5678 > >It at least needs a comment explaining the difference between the >settings, if indeed you intend there to be one and the second >setting doesn't override the first entirely. > >Since the 'http_proxy' environment variable overrides the dillorc >'http_proxy' setting, 'https_proxy' implies that the same will >apply to that, and it's anyone's guess which will apply if both >are set since other software (Wget, Lynx) doesn't apply the >'http_proxy' environment variable to https. Exactly, I think the logical behavior makes sense. Having both http_proxy and https_proxy as environment variables *and* dillorc options. Each controlling the HTTP and HTTPS proxy independently. The same in the future for ftp_proxy to route FTP traffic. >This is why I now think it best to avoid the 'https_proxy' name, >because the behaviour with it will never be consistent with other >software without changing how Dillo already handles the >'http_proxy' variable/setting. I undertand, but I think this is a good moment to plan how to change how Dillo handles the http_proxy variable, so it only affects HTTP traffic and not HTTPS too. What about this: Setting the env vars as: http_proxy=http://localhost:1234 https_proxy= Now causes a warning (maybe also in the UI): $ dillo https://www.google.com WARNING: Setting http_proxy to specify the HTTPS proxy is deprecated, use https_proxy to define it instead. But still makes Dillo use the http_proxy both for HTTP and HTTPS for now. Also: http_proxy=http://localhost:1234 https_proxy=http://localhost:1235 No warning: $ dillo https://www.google.com But Dillo uses both proxies independently (like curl or wget), instead of the current implementation that would use http_proxy for HTTP and HTTPS. Same with the dillorc options http_proxy and https_proxy (new), keeping the preference for the env vars if defined. The only unexpected change may be for a user that had previously set https_proxy that was not being used by Dillo, and now it would be. But I think that 1) is unlikely they use a different value for HTTP and HTTPS and 2) it is probably intended to use the https_proxy for HTTPS anyway. We could emit a warning about this too, but maybe not needed if we explain that Dillo will handle now the https_proxy variable. In any case, this should be properly explained in the release notes, leaving one release with the deprecation warning for users to take time to change the behavior, before we stop using http_proxy as the HTTPS proxy. I think this has the benefit of being the implementation most users would expect, as it is consisten with other tools, while having the least amount of pain for current users of proxies as they would have time to realize the deprecation notice. That would allow you to specify *only* the https_proxy like this: http_proxy= https_proxy=http://localhost:1235 $ dillo https://www.google.com No warning and Dillo uses https_proxy for HTTPS and HTTP doesn't use a proxy. And over this change, you can add your specific option in dillorc only to change the way Dillo communicates with the HTTPS proxy to avoid the CONNECT, with the "https_proxy_use_http=TRUE" or similar option. Lastly, a similar option was mentioned by Daniel (curl lead developer) some time ago: https://stackoverflow.com/a/34268925 Best, Rodrigo

June 26, 2024

Re: Feature idea: zoom buttons

by Rodrigo Arias

Hi, On Wed, Jun 26, 2024 at 03:26:59PM +0200, a1ex(a)dismail.de wrote: >Hi Rodrigo, > >On Tue, 25 Jun 2024 21:33:54 +0200 >Rodrigo Arias <rodarima(a)gmail.com> wrote: > >> I just merged support for zoom control: >> >> https://github.com/dillo-browser/dillo/pull/156 > >Thanks very much for making this feature happen! > >One thing which I would suggest is also having optional toolbar buttons >to control this. Yeah, I thought about adding three new menu items in the main menu or under a sub-menu, but I like the idea of Firefox and Chromium where they placed both the [-] [+] buttons inside a main menu item. Not sure how hard it would be to do with FLTK. >I would like to think that the Dillo project strives for maximum >accessibility whenever possible, since pretty much all of the other >features are available with mouse controls. There are a variety of >scenerios where this can be desirable. I would like to make Dillo more accessible, but we would need more developers to help. I checked a bit how to integrate it with orca or other text readers but I don't have much experience on that area. >Maybe I could attempt to kludge together a patch at some point, if >there are no other more qualified takers, of course. Thanks, that would be nice. Best, Rodrigo.

June 26, 2024

Re: Feature idea: zoom buttons

by a1ex＠dismail.de

Hi Rodrigo, On Tue, 25 Jun 2024 21:33:54 +0200 Rodrigo Arias <rodarima(a)gmail.com> wrote: > I just merged support for zoom control: > > https://github.com/dillo-browser/dillo/pull/156 Thanks very much for making this feature happen! One thing which I would suggest is also having optional toolbar buttons to control this. I would like to think that the Dillo project strives for maximum accessibility whenever possible, since pretty much all of the other features are available with mouse controls. There are a variety of scenerios where this can be desirable. Maybe I could attempt to kludge together a patch at some point, if there are no other more qualified takers, of course. Regards, Alex

June 26, 2024

Re: HTTPS Proxy Support

by Kevin Koster

Rodrigo Arias <rodarima-Re5JQEeQqe8AvxtiuMwx3w(a)public.gmane.org> wrote: >>Also I don't think that 'https_endpoint' actually needs to be set >>from an environment variable, just a dillorc setting would do. > > I also think is good if it is only a dillorc option. I'm not sure if I > like more something like: > > https_proxy=http://localhost:1234 Ahh, that's what I was doing wrong with Lynx! I didn't include the "http://" part (which Wget doesn't require, though I see now that the Wget manual does say it should be set to a URL, not a hostname). I really do make a meal of this proxy stuff. > # Setting this to TRUE sends HTTPS traffic unencrypted to the proxy. > # Don't change unless you know what you are doing. > #https_proxy_use_http=FALSE (default) > https_proxy_use_http=TRUE > > For normal uses, setting the https proxy with https_proxy would make > more sense than using http_proxy for HTTPS traffic anyway. If the 'http_proxy' behaviour changes to only apply to HTTP like in other software, everyone using the 'http_proxy' setting will have to change their configuration to set 'https_proxy' as well. That'd be an annoying behaviour change. But otherwise using the setting name 'https_proxy' makes it unclear how that relates to the 'http_proxy' setting that applies to both HTTP and HTTPS. If I set: http_proxy=http://localhost:1234 https_proxy=http://localhost:5678 It at least needs a comment explaining the difference between the settings, if indeed you intend there to be one and the second setting doesn't override the first entirely. Since the 'http_proxy' environment variable overrides the dillorc 'http_proxy' setting, 'https_proxy' implies that the same will apply to that, and it's anyone's guess which will apply if both are set since other software (Wget, Lynx) doesn't apply the 'http_proxy' environment variable to https. This is why I now think it best to avoid the 'https_proxy' name, because the behaviour with it will never be consistent with other software without changing how Dillo already handles the 'http_proxy' variable/setting.

June 25, 2024

Unexpected behaviour.

by D

html tag <caption> makes the table wider. --

June 25, 2024

dillorc long line word wrap

by pastebin＠gmx.com

Hi, doesn't this dillorc option make 'long text lines' wrap properly in the dillo display area? # Set this to YES to limit the word wrap width to the viewport width #limit_text_width=NO limit_text_width=YES https://hosted.ap.org/article/e5ac7de893189c11c88137fe9b81829e/shot-16-seco…

June 25, 2024

Re: 'Dillo Downloads' box cutnpaste

by Rodrigo Arias

On Sat, Jun 22, 2024 at 01:05:53PM -0600, pastebin(a)gmx.com wrote: >Hi > >any chance that the 'mouse exit from file name location' in the >'Dillo Downloads' dialog box (where 'target file tooltip' disappears) >to 'mouse exist from 'Dillo Downloads' dialog box itself? i think >this would allow cutnpaste of the information in the tooltip > >or could you tell me where the code might be for 'mouse exit from file >name location' action? The code that handles the downloads dialog is at dpi/downloads.cc but not sure how to do that. Rodrigo.

June 25, 2024

Re: HTTPS Proxy Support

by Rodrigo Arias

Hi, On Sun, Jun 23, 2024 at 11:02:54AM +1000, Kevin Koster wrote: >Or at least based on looking at Squid and Nginx, internet-wide >"reverse" proxy isage isn't documented clearly enough for me to >spot the easy way of doing it (while also manipulating the >content being retrieved). I did see a very hard way to do it with >Squid and an abandoned 3rd-party library that wouldn't even compile >for me. Yeah, probably using carl is much easier to setup. >Also I don't think that 'https_endpoint' actually needs to be set >from an environment variable, just a dillorc setting would do. I also think is good if it is only a dillorc option. I'm not sure if I like more something like: https_proxy=http://localhost:1234 # Setting this to TRUE sends HTTPS traffic unencrypted to the proxy. # Don't change unless you know what you are doing. #https_proxy_use_http=FALSE (default) https_proxy_use_http=TRUE For normal uses, setting the https proxy with https_proxy would make more sense than using http_proxy for HTTPS traffic anyway. Best, Rodrigo.

June 25, 2024

Re: Feature idea: zoom buttons

by Rodrigo Arias

Hi, On Sat, May 04, 2024 at 01:44:11PM +0200, Rodrigo Arias wrote: >>One thing I will note however, on a TKL (ten key less) keyboard, there >>is no dedicated '+' key, so zooming in doesn't work. On a US layout >>for example, the key is =/+, but pressing Ctrl-Shift-= doesn't have >>the expected result. I changed the mapping in keys.cc to Ctrl-= and it >>works for me, but would vary for other localizations. > >I choose the Ctrl + / Ctrl - as it is the default in other browsers, >but I mostly use Ctrl and the mouse wheel. I haven't been able to >figure it out how to make it work yet on Dillo, but maybe that would >help you too. I just merged support for zoom control: https://github.com/dillo-browser/dillo/pull/156 You can use both Ctrl-+ (non-US) or Ctrl-= (US) by default to zoom in. Best, Rodrigo.

June 25, 2024

Re: HTTPS Proxy Support

by Kevin Koster

Rodrigo Arias <rodarima-Re5JQEeQqe8AvxtiuMwx3w(a)public.gmane.org> wrote: > On Sat, Jun 22, 2024 at 09:43:00AM +1000, Kevin Koster wrote: >>But the proxy approach allows old versions/binaries to keep working >>too. If Dillo 3.0.5 had supported it, then the HTTPS issues from >>lacking SNI support could have been worked around by running an >>'old-style' HTTPS proxy with SNI support on localhost. > > A related term seems to be "reverse proxy": > > https://en.wikipedia.org/wiki/Reverse_proxy Yes, though in practice that tends to imply a caching proxy run by website operators, hence "reverse" because a normal proxy is run by the person accessing the content on other people's servers, but these are run by the server operators. But the mechanism is the same as my usage. Real-world "reverse proxies" just tend to be geared away from internet-wide usage to serve requests to any server, not least because HTTPS requires the proxy to have the target website's certificate. Or at least based on looking at Squid and Nginx, internet-wide "reverse" proxy isage isn't documented clearly enough for me to spot the easy way of doing it (while also manipulating the content being retrieved). I did see a very hard way to do it with Squid and an abandoned 3rd-party library that wouldn't even compile for me. > From the "Fun with Crypto Ancienne" post I understand that you want > Dillo to get a HTTP or HTTPS URL and always perform a HTTP GET towards > your proxy, as the Mosaic configuration suggests: > >> https 127.0.0.1 8765 http >> http 127.0.0.1 8765 http Yes. Which, if it helps to decode my earlier posts, is equivalent to this Wget command before they secretly changed its https_proxy behaviour: http_proxy=127.0.0.1:8765 https_proxy=127.0.0.1:8765 wget https://example.com > Other that those old browsers, I don't think you can do this with any > (relatively) modern tool. Which is annoying because I didn't need it until (relatively) recently. It looks like current Lynx is designed to use HTTPS tunneling through proxies now, based on use of the do_connect variable in WWW/Library/Implementation/HTTP.c of its source code. Though with Lynx 2.8.9rel.1 and 2.9.0dev.6 I can't actually get it to talk to anything (inc. Netcat on localhost) with http_proxy or https_proxy, even though setting each variable causes page loads to fail over the respective protocol. Not a firewall issue. > This is what Dillo is currently doing for https and http URLs: > > hop% http_proxy=http://localhost:1234 dillo http://www.google.com > hop% nc -l 1234 > GET http://www.google.com/ HTTP/1.1 > Host: www.google.com > User-Agent: Dillo/3.1.1 > Accept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8 > Accept-Encoding: gzip, deflate > DNT: 1 > Referer: http://www.google.com/ > Connection: keep-alive > > hop% http_proxy=http://localhost:1234 dillo https://www.google.com > hop% nc -l 1234 > CONNECT www.google.com:443 HTTP/1.1 > Host: www.google.com:443 > > While for the latter you'll want: > > GET https://www.google.com/ HTTP/1.1 > Host: www.google.com > User-Agent: Dillo/3.1.1 > Accept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8 > Accept-Encoding: gzip, deflate > DNT: 1 > Referer: https://www.google.com/ > Connection: keep-alive > > You'll need to instruct Dillo to ignore the HTTPS handling and just > treat it as an HTTP GET request to the proxy (using the HTTPS url), so > no CONNECT is used. Yes, though ideally like in Wget this behaviour wouldn't be caused by setting 'http_proxy'. You'd have a variable/setting like Wget's 'https_proxy' which only causes HTTPS connections to try and use the proxy, while HTTP connections go through directly. Then you could set 'http_proxy' as well if you wanted to use a proxy for HTTP connections too. For example (with 'https_endpoint' instead of the confusing 'https_proxy' variable/setting name I proposed earlier): http_proxy=127.0.0.1:1234 dillo http://www.google.com [ 127.0.0.1:1234 ] GET http://www.google.com/ HTTP/1.1 http_proxy=127.0.0.1:1234 dillo https://www.google.com [ 127.0.0.1:1234 ] CONNECT www.google.com:443 HTTP/1.1 https_endpoint=127.0.0.1:5678 dillo http://www.google.com [ www.google.com:80 ] GET http://www.google.com/ HTTP/1.1 https_endpoint=127.0.0.1:5678 dillo https://www.google.com [ 127.0.0.1:5678 ] GET https://www.google.com/ HTTP/1.1 http_proxy=127.0.0.1:1234 https_endpoint=127.0.0.1:5678 dillo http://www.google.com [ 127.0.0.1:1234 ] GET http://www.google.com/ HTTP/1.1 http_proxy=127.0.0.1:1234 https_endpoint=127.0.0.1:5678 dillo https://www.google.com [ 127.0.0.1:5678 ] GET https://www.google.com/ HTTP/1.1 So the behaviour of 'http_proxy' alone isn't changed. Also I don't think that 'https_endpoint' actually needs to be set from an environment variable, just a dillorc setting would do.

June 23, 2024