20170808-sl-update-error
Summary
- Error in SL-Update
- Add link on oddb.org for drugshortage
- Analyse errors found for oddb.org
- Keep in Mind
Commits
- https://github.com/ngiger/oddb.org/commit/78ae2b0b546866c0cbaeb1e30619d52beffd1170 Fix logging when running import_bsv
- http://oddb-ci2.dyndns.org/en/gcc/feedbacks/reg/56235/seq/03/pack/022 Fix feedbacks errors
- https://github.com/ngiger/oddb.org/commit/0a9bdfc5e4ea3391ca42bd219296b0d91731afe8 Fixed error when visiting interaction_basket
- https://github.com/ngiger/oddb.org/commit/6ae197fc08f099210b4a725ac66b6671c0a990c7 Fix ddd_chart with nil price
- https://github.com/ngiger/oddb.org/commit/cab79215020c2f3ef6669deb1ac5af3fef3dcb9f Return nice 404 error for non existing files
- https://github.com/ngiger/oddb.org/commit/bdfe71421c7dc4d0a0d92454e224c1ab034201cd Use HTTP404 state for missing RSS files
- https://github.com/ngiger/oddb.org/commit/813d6233d399319cfaa6e84b4551fb05c53f3ad2 Add drugshortage to ikscat
- https://github.com/ngiger/oddb.org/commit/a4ab8f622d47293e5741a1c4b3eb6a1ee4f313e6 Avoid nil pointer in interactions when no atc_class given
- https://github.com/ngiger/oddb.org/commit/b53dace2dc04eca959536f61ca9d408a24833933 Fix unit test for state/global
- https://github.com/ngiger/oddb.org/commit/ad69bf0cc67eb1d9b3a854baf89bfa114a665152 Use SBSM 1.5.8 to avoid mime errors
- https://github.com/ngiger/oddb.org/commit/4ca9245e0f668d0bfe69add4541315a7a6c7434b Fix errors in unit-test (drugshortage)
- https://github.com/ngiger/sbsm/commit/5b14238f9976ccc481d492d72c3bedb50c1c622f Return nice 404 error for non existing files
- https://github.com/ngiger/sbsm/commit/16497af27bcd03ea948fc4667a321c6cdc4c1245 Bumped version to 1.5.7
- https://github.com/ngiger/sbsm/commit/6fa2aaeb9dde23a50e3fd30f812ec1971fea919a Fix recognizing mime type for unusual extensions
- https://github.com/ngiger/sbsm/commit/20d81d81f0aa7638a8ce8884d4fefff8b1964fe5 Bumped version to 1.5.8
Index
Error in SL-Update
My local patch of yesterday was okay. Pushed commit Fix logging when running import_bsv
Add link on oddb.org for drugshortage
Test is for 7680004170027 Tollwut Impfstoff Mérieux. Testing via URL http://oddb-ci2.dyndns.org//de/gcc/search/zone/admin/search_query/Tollwut%20Impfstoff/search_type/st_sequence
It took me a while to find the HTML code for a lager bullet and getting the font size right. Now it looks quite nice
And the pop-up is:
When the shortage_state is != 1, a green bullet is shown. If no shortage_state is defined, nothing is displayed.
Pushed commit Add drugshortage to ikscat
Analyse errors found for oddb.org
The following URL had error
- http://oddb-ci2.dyndns.org/en/gcc/feedbacks/reg/56235/seq/03/pack/022 (Fixed with commit Fix feedbacks errors)
- http://oddb-ci2.dyndns.org/en/gcc/interaction_basket/substance_ids/5893+4020+6129+1755 (Fixed with commit Fixed error when visiting interaction_basket)
de/gcc/ddd_chart/for/56689009_Gonal-f_PEN_900_U.I./1.5_ml_Tageskostenvergleich.png(Fixed with commit Fix ddd_chart with nil price- http://oddb-ci2.dyndns.org/nd/gcc/rss/channel/price_rise.rss
Improved handling of non existing files in SBSM. Now calling http://oddb-ci2.dyndns.org/nd/gcc/rss/channel/price_rise.rss returns /var/www/oddb.org/data/rss/nd/price_rise.rss Not found
Pushed commits
Released SBSM 1.5.7.
But oddb.org has also a state HTTP_404, which we reach when calling http://oddb-ci2.dyndns.org/nd/gcc/rss/channel/price_risexx.rss, but not when using http://oddb-ci2.dyndns.org/nd/gcc/rss/channel/price_rise.rss. Why?
Fixed with commits
But the open question is, why does http://oddb-ci2.dyndns.org/de/gcc/sort/state_id/47426989787680/sortvalue/ddd_price not calculate a correct daily cost for the packages of 56689 Gonal-f PEN.
Pulled the changes to thinpower. To force the BSV-Plugin I called (being in /var/www/oddb.org) cp -p data/xml/XMLPublications-2017.07.20.zip data/xml/XMLPublications-latest.zip
Created a small helper file Attach:yesterday_errors.txt, which gives me the following output on thinpower
time ~/yesterday_errors
Results for the 2017-08-07. Analysing 6 logfiles matching /var/www/oddb.org/log/2017/08/07/*log
----------------------------
Exceptions
86 errors in /var/www/oddb.org/log/2017/08/07/crawler_log ( 27223 kB)
34 errors in /var/www/oddb.org/log/2017/08/07/just-medical_log (272630 kB)
26 errors in /var/www/oddb.org/log/2017/08/07/user_log (104739 kB)
6 errors in /var/www/oddb.org/log/2017/08/07/google_crawler_log ( 1258 kB)
4 errors in /var/www/oddb.org/log/2017/08/07/generika_log ( 781 kB)
----------------------------
Restarts
40 restarts in /var/www/oddb.org/log/2017/08/07/crawler_log
----------------------------
real 0m25.127s
user 0m24.571s
sys 0m0.542s
Improved the script to see the different reasons Attach:yesterday_errors2.txt Δ, which gives me the following output on thinpower
time ~/yesterday_errors
Results for the 2017-08-07. Analysing 6 logfiles matching /var/www/oddb.org/log/2017/08/07/*log
--------------------------------------------------------------------------------------------------------------
2017-08-08 13:05:52 +0200: Analysing /var/www/oddb.org/log/2017/08/07/crawler_log ( 27223 kB)
2017-08-08 13:05:56 +0200: Analysing /var/www/oddb.org/log/2017/08/07/evidentia_log ( 333 kB)
2017-08-08 13:05:57 +0200: Analysing /var/www/oddb.org/log/2017/08/07/generika_log ( 781 kB)
2017-08-08 13:05:57 +0200: Analysing /var/www/oddb.org/log/2017/08/07/google_crawler_log ( 1258 kB)
2017-08-08 13:05:57 +0200: Analysing /var/www/oddb.org/log/2017/08/07/just-medical_log (272630 kB)
2017-08-08 13:07:56 +0200: Analysing /var/www/oddb.org/log/2017/08/07/user_log (104739 kB)
--------------------------------------------------------------------------------------------------------------
Exceptions
86 Errors in /var/www/oddb.org/log/2017/08/07/crawler_log ( 27223 kB)
34 Errors in /var/www/oddb.org/log/2017/08/07/just-medical_log (272630 kB)
26 Errors in /var/www/oddb.org/log/2017/08/07/user_log (104739 kB)
6 Errors in /var/www/oddb.org/log/2017/08/07/google_crawler_log ( 1258 kB)
4 Errors in /var/www/oddb.org/log/2017/08/07/generika_log ( 781 kB)
--------------------------------------------------------------------------------------------------------------
Restarts
40 Restarts in /var/www/oddb.org/log/2017/08/07/crawler_log
--------------------------------------------------------------------------------------------------------------
Detailled summary of occurences by reason (for all logfiles combined)
102 NoMethodError: undefined method `[]' for nil:NilClass
6 TypeError: can't convert nil into Float
2 NameError: uninitialized constant ODDB::State::Interactions::Basket
6 Errno::ENOENT: No such file or directory @ rb_file_s_size - /var/www/oddb.org/data/rss/nd/price_rise.rss
6 Errno::ENOENT: No such file or directory @ rb_file_s_size - /var/www/oddb.org/data/rss/nd/recall.rss
4 NoMethodError: undefined method `introduction_date' for nil:NilClass
10 NoMethodError: undefined method `code' for nil:NilClass
2 NameError: uninitialized constant ODDB::State::Interactions::EmptyBasket
2 ArgumentError: invalid byte sequence in UTF-8
2 RuntimeError: can't add a new key into hash during iteration
4
6 /var/www/oddb.org/vendor/ruby/2.4.0/gems/rack-2.0.3/lib/rack/lint.rb:20:in `assert'
1 /var/www/oddb.org/vendor/ruby/2.4.0/gems/rack-2.0.3/lib/rack/lint.rb:688:in `verify_content_length'
1 /usr/local/ruby-2.4.0/lib/ruby/2.4.0/webrick/httpserver.rb:96:in `run'
1 /var/www/oddb.org/vendor/ruby/2.4.0/gems/rack-2.0.3/lib/rack/chunked.rb:54:in `call'
1 ODDB::View::Interactions::InteractionChooserComposite::COMPONENTS[[0, 0]] in create(ODDB::View::Interactions::InteractionChooserForm)
--------------------------------------------------------------------------------------------------------------
real 2m47.090s
user 2m45.684s
sys 0m1.372s
Looking at http://oddb-ci2.dyndns.org/de/gcc/rezept/ean/7680651330010. Fixed with commit Avoid nil pointer in interactions when no atc_class given
As travis-ci reported error I had to fix them with commits
Remarked that loading /resources/dojo/dijit/_base/window.js.map throws an error in sbsm/lib/app.rb.
Fixed with commits