Quick optimisations

DHD20240216: reduced redundant data fetch to ~2 intervals.
DHD20240216: Proguard minified JAR build working again.
DHD20240216: some dead Twitter code removed.

Smaller JAR is worthwhile, especially since checked in!

108038 16 Feb 10:44 .work/reutils-1.4.0.jar
 66410 16 Feb 15:44 .work/edhMain.reutils-1.4.1.jar

Uses new streaming JSON FUELINST source

DHD20240212: broke out FileUtils from DataUtils.
DHD20240212: added json-20240205.jar (org.json, public domain).
DHD20240215: now fetches from new FUELINST JSON streaming API.
DHD20240215: have rationalised cacheing etc somewhat; needs tidy-up of doTrafficLights().
DHD20240215: fetches only as much data as needed (not usually full 24h).
DHD20240215: changed recent data fetch to max of 48h (from 24h).

V1.3.0

Zenodo release.

DHD20231228: additional testing, eg of intensities for next year.

Stale data flag

DHD20230928: added 'stale' flag: can retry poll faster if stale flag file present.

Tooting less noise

The BMRS system seems to be glitching more often.

The right thing to do soon will be to switch over to the new APIs and build a more resilient interface.

In the interim I want to reduce the amount of noisy toots on Mastodon by refusing to post if the data is not live.

DHD20230928: avoiding posting inferred intensity, ie when live data is missing.

Twitter kill switch activated

Saves a few bytes and cycles avoiding being rejected when trying to post...

DHD20230205: added compile-time Twitter kill switch TwitterUtils.ENABLE_TWEETING.
DHD20230410: activated kill switch given that posting apparently broke 2023-04-07 ~14:00Z.

Raising Mastodon visibility

Slowly downgrading Twitter and upgrading Mastodon given continuing instability of the former.

DHD20230115: trimmed logging to better fit console!
DHD20230129: task re-ordering for performance.
DHD20230129: added Mastodon link on HTML page above that for Twitter.

Fix for Twitter link mangling

DHD20230124: using ' ' rather than '|' as tweet timestamp separator to avoid breaking links.

Fix for broken incoming data

Incoming data borked in a new way: misordered timestamps, now repairable (by discarding anything older than the newest seen so far) so as to not lose a day (though still worrying)...

...
WARNING: [FUELINST, 20230122, 12, 20230122055500, 5380, 0, 501, 5171, 6616, 0, 374, 0, 190, 651, 400, 1002, 153, 2017, 989, 259, 384, 1257]
WARNING: [FUELINST, 20230122, 12, 20230122060000, 5779, 0, 500, 5172, 6614, 0, 374, 0, 165, 547, 400, 1003, 127, 2005, 985, 251, 344, 1257]
WARNING: [FUELINST, 20230122, 13, 20230122061500, 6749, 0, 498, 5175, 6601, 0, 377, 0, 166, 125, 400, 1003, 51, 2010, 862, 227, 219, 1257]
WARNING: [FUELINST, 20230122, 13, 20230122062000, 6951, 0, 500, 5175, 6539, 0, 376, 0, 167, 125, 400, 1003, 45, 2014, 862, 227, 219, 1257]
WARNING: [FUELINST, 20230122, 13, 20230122060500, 6320, 0, 499, 5177, 6617, 0, 375, 0, 164, 249, 400, 1003, 102, 2001, 867, 236, 260, 1257]
WARNING: [FUELINST, 20230122, 13, 20230122061000, 6575, 0, 499, 5175, 6656, 0, 377, 0, 165, 125, 400, 1004, 77, 2010, 862, 227, 219, 1257]
WARNING: [FUELINST, 20230122, 13, 20230122062500, 7171, 0, 499, 5176, 6489, 0, 375, 0, 168, 125, 397, 1004, 68, 2013, 862, 227, 219, 1257]
WARNING: [FUELINST, 20230122, 13, 20230122063000, 7055, 0, 500, 5179, 6458, 0, 374, 0, 187, 125, 376, 1004, 93, 2016, 862, 227, 219, 1257]
WARNING: [FUELINST, 20230122, 14, 20230122063500, 7265, 0, 501, 5172, 6454, 0, 374, 0, 181, 125, 352, 1002, 119, 2015, 862, 227, 219, 1257]
WARNING: [FUELINST, 20230122, 14, 20230122064000, 7410, 0, 499, 5167, 6454, 0, 375, 0, 195, 125, 326, 1003, 144, 2016, 862, 227, 219, 1257]
WARNING: [FUELINST, 20230122, 14, 20230122065500, 8015, 0, 499, 5175, 6585, 0, 379, 0, 168, 125, 251, 1001, 129, 1996, 863, 227, 219, 1257]
WARNING: [FUELINST, 20230122, 14, 20230122064500, 7511, 0, 499, 5169, 6470, 0, 375, 0, 205, 125, 302, 1003, 168, 2016, 862, 227, 219, 1257]
WARNING: [FUELINST, 20230122, 14, 20230122065000, 7752, 0, 499, 5171, 6512, 0, 375, 0, 170, 125, 276, 1003, 154, 2009, 863, 227, 219, 1257]
...

More logging of performance bottlenecks

More l

DHD20230117: added computeTime_ms to CurrentSummary toString() result.
DHD20230117: more code reordering for potential increased performance.
DHD20230117: reporting where long tasks are delaying progress.