sven/rsi.git
3 weeks agoremove old protezione civile radar image master
Sven Hoexter [Tue, 22 Oct 2019 09:59:40 +0000 (11:59 +0200)]
remove old protezione civile radar image

7 months agoupdate radar image URL, disable SF.tv for the moment
Sven Hoexter [Sat, 23 Mar 2019 19:17:54 +0000 (20:17 +0100)]
update radar image URL, disable SF.tv for the moment

15 months agoFilter out stupid Prognoseregionen teaser
Sven Hoexter [Sat, 4 Aug 2018 13:53:32 +0000 (15:53 +0200)]
Filter out stupid Prognoseregionen teaser

15 months agoadd a C for Celsius
Sven Hoexter [Sun, 22 Jul 2018 10:38:20 +0000 (12:38 +0200)]
add a C for Celsius

15 months agoMerge branch 'master' of ssh://git.sven.stormbind.net/home/sven/repos/rsi
Sven Hoexter [Sun, 22 Jul 2018 10:35:55 +0000 (12:35 +0200)]
Merge branch 'master' of ssh://git.sven.stormbind.net/home/sven/repos/rsi

15 months agoAnother try on parsing 3b meteo for the sprite table
Sven Hoexter [Sun, 22 Jul 2018 10:35:43 +0000 (12:35 +0200)]
Another try on parsing 3b meteo for the sprite table

16 months agoMigrate SMA to https
Sven Hoexter [Wed, 27 Jun 2018 21:08:07 +0000 (23:08 +0200)]
Migrate SMA to https

20 months agoextract the trend and trend date for display
Sven Hoexter [Sun, 18 Mar 2018 13:13:40 +0000 (14:13 +0100)]
extract the trend and trend date for display

22 months agoRemove superflous links, RSI is so far off it does not make sense anymore
Sven Hoexter [Mon, 25 Dec 2017 19:58:22 +0000 (20:58 +0100)]
Remove superflous links, RSI is so far off it does not make sense anymore

22 months agoadd degree symbol
Sven Hoexter [Fri, 22 Dec 2017 16:18:52 +0000 (17:18 +0100)]
add degree symbol

22 months agoMove everything left to TclCurl
Sven Höxter [Wed, 20 Dec 2017 22:02:25 +0000 (23:02 +0100)]
Move everything left to TclCurl

22 months agofixup the 3bmeteo sprite parsing
Sven Höxter [Wed, 20 Dec 2017 20:55:59 +0000 (21:55 +0100)]
fixup the 3bmeteo sprite parsing

This is more then ever based on luck.
In case we believe we found a <span> tag in the line before (contains
date and day name) we do wild regex on the next line to extract the
sprite and the lower celsius degree value.
In case we're not the line after a <span> tag we still try our luck to
find something that looks like celisus degree. Usually that should be
the upper limit of the current day. That's then where we close the day
and the table field to move on.

22 months agoremove superflous commented out old http code
Sven Höxter [Wed, 20 Dec 2017 20:07:44 +0000 (21:07 +0100)]
remove superflous commented out old http code

23 months agomigrate to TclCurl and use HTTPS endpoints all the way
Sven Höxter [Mon, 18 Dec 2017 19:33:39 +0000 (20:33 +0100)]
migrate to TclCurl and use HTTPS endpoints all the way

23 months agoreenable SRF with tclcurl and HTTPS
Sven Höxter [Mon, 18 Dec 2017 19:11:16 +0000 (20:11 +0100)]
reenable SRF with tclcurl and HTTPS

2 years agothrow out the SFR trend completely
Sven Hoexter [Sat, 1 Jul 2017 09:34:43 +0000 (11:34 +0200)]
throw out the SFR trend completely

2 years agomake the frontendkarte removal a bit more fuzzy - see various results from the fronte...
Sven Hoexter [Thu, 4 May 2017 08:36:43 +0000 (10:36 +0200)]
make the frontendkarte removal a bit more fuzzy - see various results from the frontend systems

2 years agotry to clean a few more alt tags
Sven Hoexter [Thu, 4 May 2017 08:25:42 +0000 (10:25 +0200)]
try to clean a few more alt tags

2 years agoquick hack: broaden regsub to replace more SRF image cruft
Sven Hoexter [Thu, 4 May 2017 08:20:05 +0000 (10:20 +0200)]
quick hack: broaden regsub to replace more SRF image cruft

2 years agoTrash a bit more of the SRF html to not show region images or alt text.
Sven Hoexter [Tue, 11 Apr 2017 15:28:44 +0000 (17:28 +0200)]
Trash a bit more of the SRF html to not show region images or alt text.

2 years agoSwitch to TclCurl for rsit as well - for some reason we receive an incomplete file...
Sven Hoexter [Thu, 23 Feb 2017 22:54:49 +0000 (23:54 +0100)]
Switch to TclCurl for rsit as well - for some reason we receive an incomplete file when we download with the standard http module

2 years agoTry again an explicit output filter via regsub. This time for SMA. Wildcard matches...
Sven Hoexter [Thu, 23 Feb 2017 22:33:16 +0000 (23:33 +0100)]
Try again an explicit output filter via regsub. This time for SMA. Wildcard matches with Tcl just suck. So here is an exact match.

2 years agochange back rsi url to http - we intentionally do not support https
Sven Hoexter [Thu, 23 Feb 2017 21:51:31 +0000 (22:51 +0100)]
change back rsi url to http - we intentionally do not support https

2 years agouse curl via TclCurl to download 3bmeteo data input
Sven Hoexter [Thu, 23 Feb 2017 21:49:24 +0000 (22:49 +0100)]
use curl via TclCurl to download 3bmeteo data input

2 years ago3bmeteo moved to https only
Sven Hoexter [Thu, 23 Feb 2017 21:37:49 +0000 (22:37 +0100)]
3bmeteo moved to https only

2 years agotest the 3bmeteo iframe
Sven Hoexter [Fri, 30 Dec 2016 20:05:12 +0000 (21:05 +0100)]
test the 3bmeteo iframe

2 years agoAdd a few comments for clarification.
Sven Hoexter [Fri, 30 Dec 2016 19:41:37 +0000 (20:41 +0100)]
Add a few comments for clarification.

2 years agoIncrement the outnum counter only when we print a day and not on every line we process.
Sven Hoexter [Fri, 30 Dec 2016 19:38:02 +0000 (20:38 +0100)]
Increment the outnum counter only when we print a day and not on every line we process.

2 years agotry to start a new row every four days
Sven Hoexter [Fri, 30 Dec 2016 19:29:53 +0000 (20:29 +0100)]
try to start a new row every four days

2 years agoset css border only for table cells
Sven Hoexter [Fri, 30 Dec 2016 19:22:49 +0000 (20:22 +0100)]
set css border only for table cells

2 years agoadd table border to 3b css file
Sven Hoexter [Fri, 30 Dec 2016 19:20:45 +0000 (20:20 +0100)]
add table border to 3b css file

2 years agoMove finalized 3b meteo output to the end of the page, very exprimental, might break...
Sven Hoexter [Fri, 30 Dec 2016 19:06:01 +0000 (20:06 +0100)]
Move finalized 3b meteo output to the end of the page, very exprimental, might break the rest of the page

2 years agoprevent doublicate lines, only print sprite line if the previous line was a span tag
Sven Hoexter [Fri, 30 Dec 2016 19:03:44 +0000 (20:03 +0100)]
prevent doublicate lines, only print sprite line if the previous line was a span tag

2 years agotry to wrap the output in one table row
Sven Hoexter [Fri, 30 Dec 2016 18:57:16 +0000 (19:57 +0100)]
try to wrap the output in one table row

2 years agoStart match at the beginning of the line for span filtering.
Sven Hoexter [Fri, 30 Dec 2016 18:52:54 +0000 (19:52 +0100)]
Start match at the beginning of the line for span filtering.

2 years agoTry line based processing
Sven Hoexter [Fri, 30 Dec 2016 18:44:31 +0000 (19:44 +0100)]
Try line based processing

2 years agotry another filter approach
Sven Hoexter [Fri, 30 Dec 2016 17:33:07 +0000 (18:33 +0100)]
try another filter approach

2 years agoFirst try to implement 3b meteo import for Calasca-Castiglione.
Sven Hoexter [Fri, 30 Dec 2016 17:09:33 +0000 (18:09 +0100)]
First try to implement 3b meteo import for Calasca-Castiglione.

- Adds the weather icon sprite from 3b
- Adds the CSS definition for the 3b sprite
- Extracts the basic weather information block from the 3b website

2 years agoFetch a radar picture from Italien Protezione Civile.
Sven Hoexter [Sat, 17 Dec 2016 13:15:50 +0000 (14:15 +0100)]
Fetch a radar picture from Italien Protezione Civile.

2 years agoThe days has arrived and even the NZZ has no classic rader gif anymore - disbled...
Sven Hoexter [Sat, 17 Dec 2016 11:39:41 +0000 (12:39 +0100)]
The days has arrived and even the NZZ has no classic rader gif anymore - disbled for the moment

2 years agofix srf region image replacement, changed to https and a different URL as a whole
Sven Hoexter [Thu, 1 Dec 2016 21:29:25 +0000 (22:29 +0100)]
fix srf region image replacement, changed to https and a different URL as a whole

3 years agoChange img URL pattern for rsi.ch
Sven Hoexter [Sat, 30 Jul 2016 07:56:07 +0000 (09:56 +0200)]
Change img URL pattern for rsi.ch

3 years agoadd a Tcl 8.6 try {} around the lage output which is empty from time to time lately
Sven Hoexter [Fri, 25 Dec 2015 05:49:37 +0000 (06:49 +0100)]
add a Tcl 8.6 try {} around the lage output which is empty from time to time lately

4 years agoRemove slf hacks.
Sven Hoexter [Sun, 12 Jul 2015 20:34:44 +0000 (22:34 +0200)]
Remove slf hacks.

4 years agofix hostname where the radar image from NZZ is hosted.
Sven Hoexter [Wed, 17 Jun 2015 17:29:15 +0000 (19:29 +0200)]
fix hostname where the radar image from NZZ is hosted.

4 years agoUpdate NZZ radar image website URL
Sven Hoexter [Wed, 20 May 2015 20:33:17 +0000 (22:33 +0200)]
Update NZZ radar image website URL

4 years agodisable radar image for the moment - br0ken
Sven Hoexter [Wed, 20 May 2015 20:25:12 +0000 (22:25 +0200)]
disable radar image for the moment - br0ken

4 years agoChange 3bmeteo link.
Sven Hoexter [Fri, 27 Mar 2015 20:48:13 +0000 (21:48 +0100)]
Change 3bmeteo link.

4 years agoIncrease timeout - srf.ch is very slow ATM.
Sven Hoexter [Sun, 1 Feb 2015 11:49:46 +0000 (12:49 +0100)]
Increase timeout - srf.ch is very slow ATM.

4 years agoReplace several regsub calls with correct regexp calls.
Sven Hoexter [Fri, 19 Dec 2014 22:09:26 +0000 (23:09 +0100)]
Replace several regsub calls with correct regexp calls.

4 years agoAlso ignore .gif - nzz rader image is gif
Sven Hoexter [Fri, 19 Dec 2014 21:40:33 +0000 (22:40 +0100)]
Also ignore .gif - nzz rader image is gif

4 years agoAdd a .gitignore to ignore .jpg files as a default.
Sven Hoexter [Fri, 19 Dec 2014 21:39:09 +0000 (22:39 +0100)]
Add a .gitignore to ignore .jpg files as a default.

4 years agoRemove historic versions of various scripts nowadays aggregated in rsit.cgi and sma...
Sven Hoexter [Fri, 19 Dec 2014 21:38:14 +0000 (22:38 +0100)]
Remove historic versions of various scripts nowadays aggregated in rsit.cgi and sma.cgi.

4 years agoRefine transprogname() regex to ensure we match on the path. Saves us another regsub...
Sven Hoexter [Fri, 19 Dec 2014 21:27:24 +0000 (22:27 +0100)]
Refine transprogname() regex to ensure we match on the path. Saves us another regsub call for every image.

4 years agoSave another regsub call by better regexp usage with imgurl as a subVar.
Sven Hoexter [Fri, 19 Dec 2014 21:17:20 +0000 (22:17 +0100)]
Save another regsub call by better regexp usage with imgurl as a subVar.

4 years agoAdd 3b Valsolda link
Sven Hoexter [Tue, 16 Dec 2014 13:14:20 +0000 (14:14 +0100)]
Add 3b Valsolda link

4 years agoMove radar image back to the middle of the page.
Sven Hoexter [Tue, 16 Dec 2014 13:11:20 +0000 (14:11 +0100)]
Move radar image back to the middle of the page.

4 years agoSimply SMA extraction with regexp instead of regsub.
Sven Hoexter [Tue, 16 Dec 2014 13:07:42 +0000 (14:07 +0100)]
Simply SMA extraction with regexp instead of regsub.

4 years agoUse regexp instead of regsub.
Sven Hoexter [Tue, 16 Dec 2014 12:59:36 +0000 (13:59 +0100)]
Use regexp instead of regsub.

4 years agoReplace the nice regex with the old and fast one - saves 11s processing time for...
Sven Hoexter [Tue, 16 Dec 2014 10:57:29 +0000 (11:57 +0100)]
Replace the nice regex with the old and fast one - saves 11s processing time for now.

4 years agoRemove old SMA text extraction.
Sven Hoexter [Tue, 16 Dec 2014 10:32:52 +0000 (11:32 +0100)]
Remove old SMA text extraction.

4 years agoSwitch to converted radar image fetched from NZZ.
Sven Hoexter [Tue, 16 Dec 2014 10:31:07 +0000 (11:31 +0100)]
Switch to converted radar image fetched from NZZ.

4 years agoQuick fix - Alpensued only - for the new sma website.
Sven Hoexter [Tue, 16 Dec 2014 09:18:41 +0000 (10:18 +0100)]
Quick fix - Alpensued only - for the new sma website.

4 years agoRemove PROGNAME override, could be wrong nowadays. Requires some testing.
Sven Hoexter [Fri, 21 Nov 2014 12:58:12 +0000 (13:58 +0100)]
Remove PROGNAME override, could be wrong nowadays. Requires some testing.

4 years agoTry a fix for the next day prognosis before 1pm.
Sven Hoexter [Fri, 21 Nov 2014 11:23:46 +0000 (12:23 +0100)]
Try a fix for the next day prognosis before 1pm.

5 years agoLoosen the regex to also catch non ascii values outside of the [:alpha:] range.
Sven Hoexter [Sun, 16 Nov 2014 16:54:32 +0000 (17:54 +0100)]
Loosen the regex to also catch non ascii values outside of the [:alpha:] range.

5 years agoFirst try to fix the output date correlation
Sven Hoexter [Sun, 16 Nov 2014 12:29:59 +0000 (13:29 +0100)]
First try to fix the output date correlation

5 years agoGross hack to convert ì to %C3%AC in the imgurl.
Sven Hoexter [Sun, 16 Nov 2014 12:00:53 +0000 (13:00 +0100)]
Gross hack to convert ì to %C3%AC in the imgurl.

It seems that rsi.ch once again changed the preserved
encoding in the image url one can find in the page source.
We now encode characters, if required, to the x-www-form-urlencoded
form.

5 years agoMatch translations with encoded spaces.
Sven Hoexter [Wed, 15 Oct 2014 17:51:35 +0000 (19:51 +0200)]
Match translations with encoded spaces.

5 years agoMerge branch 'master' of /home/sven/www/sven_htdocs/git/rsi
Sven Hoexter [Sun, 12 Oct 2014 20:04:28 +0000 (22:04 +0200)]
Merge branch 'master' of /home/sven/www/sven_htdocs/git/rsi

5 years agoChange RSI link at the end of sma.cgi
Sven Hoexter [Sun, 12 Oct 2014 20:04:26 +0000 (22:04 +0200)]
Change RSI link at the end of sma.cgi

5 years agoRefine regex to extract Allgemeine Lage.
Sven Hoexter [Sun, 12 Oct 2014 20:03:16 +0000 (22:03 +0200)]
Refine regex to extract Allgemeine Lage.

5 years agoTry another pattern to extract the Allgemine Lage.
Sven Hoexter [Sat, 7 Jun 2014 20:59:51 +0000 (22:59 +0200)]
Try another pattern to extract the Allgemine Lage.
Play around with backreferences to make it somewhat easier to read.

5 years agoReadd and specify some all matching patterns and there quantifiers.
Sven Hoexter [Thu, 5 Jun 2014 17:21:01 +0000 (19:21 +0200)]
Readd and specify some all matching patterns and there quantifiers.

5 years agoTest if we can match on the subsection for the SRF allgemeine lage.
Sven Hoexter [Thu, 5 Jun 2014 17:17:51 +0000 (19:17 +0200)]
Test if we can match on the subsection for the SRF allgemeine lage.

5 years agoChange HTML declared charset to UTF8 since we changed the server ENV to
Sven Hoexter [Thu, 5 Jun 2014 16:55:07 +0000 (18:55 +0200)]
Change HTML declared charset to UTF8 since we changed the server ENV to
UTF8 for the UTF8 coded path names in the rsi.ch webpage.

5 years agoStore http::geturl token in variable ht for further usage when required.
Sven Hoexter [Fri, 30 May 2014 13:24:48 +0000 (15:24 +0200)]
Store http::geturl token in variable ht for further usage when required.

5 years agoTry to work around a bug were rsi.ch provides the same image in
Sven Hoexter [Fri, 30 May 2014 12:55:49 +0000 (14:55 +0200)]
Try to work around a bug were rsi.ch provides the same image in
different resolutions for tomorrow with the title tomorrow and
once with the title the day after tomorrow.

5 years agoComment cleanup.
Sven Hoexter [Wed, 28 May 2014 22:26:27 +0000 (00:26 +0200)]
Comment cleanup.

5 years agoFix 0000-1800 crop settings.
Sven Hoexter [Wed, 28 May 2014 22:18:48 +0000 (00:18 +0200)]
Fix 0000-1800 crop settings.

5 years agoRevert "Remove all time based assumptions, seem to be wrong at the moment."
Sven Hoexter [Wed, 28 May 2014 22:13:05 +0000 (00:13 +0200)]
Revert "Remove all time based assumptions, seem to be wrong at the moment."

This reverts commit d8edaeeeaba8602b28cde62147d9c898d0faa006.

5 years agoRemove all time based assumptions, seem to be wrong at the moment.
Sven Hoexter [Wed, 28 May 2014 22:11:10 +0000 (00:11 +0200)]
Remove all time based assumptions, seem to be wrong at the moment.

5 years agoLeave no traces and delete the downloaded html file after processing.
Sven Hoexter [Wed, 28 May 2014 19:48:21 +0000 (21:48 +0200)]
Leave no traces and delete the downloaded html file after processing.

5 years agoImplement basic <img> tag output for the GR image. Expected to be buggy as well.
Sven Hoexter [Wed, 28 May 2014 19:42:00 +0000 (21:42 +0200)]
Implement basic <img> tag output for the GR image. Expected to be buggy as well.

5 years agoReimplement basic <img> tag output.
Sven Hoexter [Wed, 28 May 2014 19:27:58 +0000 (21:27 +0200)]
Reimplement basic <img> tag output.

5 years agoRe-add the old image resize logic and adjust the offsets to what we know
Sven Hoexter [Wed, 28 May 2014 19:03:14 +0000 (21:03 +0200)]
Re-add the old image resize logic and adjust the offsets to what we know
at the moment. Expected to fail before 1800.

5 years agoStart of a complete rewrite - throw away nearly all of the old logic.
Sven Hoexter [Tue, 27 May 2014 19:22:14 +0000 (21:22 +0200)]
Start of a complete rewrite - throw away nearly all of the old logic.
rsi.ch site layout changed again to a completely new setup

We now download the rsi meteo site, parse it line wise and match for
the image url. Then we pass on the image url with a counter to a new
thread to download the image.

5 years agoAdd direct link to 3bmeteo Premosello for an external fourth prognosis.
Sven Hoexter [Sun, 20 Apr 2014 14:23:33 +0000 (16:23 +0200)]
Add direct link to 3bmeteo Premosello for an external fourth prognosis.

5 years agoClean the complete src entity from the img tag line. Stops Operas endless loading.
Sven Hoexter [Fri, 7 Mar 2014 19:26:33 +0000 (20:26 +0100)]
Clean the complete src entity from the img tag line. Stops Operas endless loading.

5 years agoinvalidate region map url for the moment to disable image loading
Sven Hoexter [Fri, 7 Mar 2014 13:01:20 +0000 (14:01 +0100)]
invalidate region map url for the moment to disable image loading

5 years agoRemove Tagesusammenfassung.
Sven Hoexter [Thu, 30 Jan 2014 11:33:25 +0000 (12:33 +0100)]
Remove Tagesusammenfassung.

5 years agoDisable Tageszusammenfassung for the moment, needs to be conditional.
Sven Hoexter [Thu, 30 Jan 2014 09:13:13 +0000 (10:13 +0100)]
Disable Tageszusammenfassung for the moment, needs to be conditional.

5 years agoSmall spelling fix.
Sven Hoexter [Wed, 29 Jan 2014 22:15:14 +0000 (23:15 +0100)]
Small spelling fix.

5 years agoAdapt to the new RSF page layout.
Sven Hoexter [Wed, 29 Jan 2014 22:11:52 +0000 (23:11 +0100)]
Adapt to the new RSF page layout.
Pro: only one page to retrieve
Con: more snippets to extract

Let's see how long the new rough pattern hold.

5 years agoFix rsi.ch image offset for the next day image.
Sven Hoexter [Sun, 19 Jan 2014 10:32:36 +0000 (11:32 +0100)]
Fix rsi.ch image offset for the next day image.

5 years agoNew cutting offsets and image sizes for rsi.ch.
Sven Hoexter [Sat, 18 Jan 2014 18:57:54 +0000 (19:57 +0100)]
New cutting offsets and image sizes for rsi.ch.

6 years agoChange RSI path, wone3 out wone4 in.
Sven Hoexter [Fri, 1 Nov 2013 19:23:22 +0000 (20:23 +0100)]
Change RSI path, wone3 out wone4 in.

6 years agoCut off pattern for the forecast date extraction at SRF adjusted
Sven Hoexter [Sat, 16 Feb 2013 22:08:56 +0000 (23:08 +0100)]
Cut off pattern for the forecast date extraction at SRF adjusted

6 years agoAdd lbm.cgi for the lower Maggia valey only. copy&pasta programming
Sven Hoexter [Tue, 18 Dec 2012 22:14:32 +0000 (23:14 +0100)]
Add lbm.cgi for the lower Maggia valey only. copy&pasta programming

6 years agoSF.tv is now srf.ch -> changed all URLs
Sven Hoexter [Tue, 18 Dec 2012 22:09:18 +0000 (23:09 +0100)]
SF.tv is now srf.ch -> changed all URLs