20120510-update-xmlconv

<< | Index | >>

Summary

• Updated xmlconv
  • updated @transactions object as prefetched
  • used ODBA.cache.prefetch
• Updated update_lppv job
• Improved ydox
  • title detecting, image reference option.

Commits

xmlconv

• Improved response with odba_prefetch
• Updated save method

oddb.org

• Updated lppv update
  • Removed price, lppa dose not have price any longer.
  • Changed to update lppv flag with EAN code.
• Created update_lppv job

ydocx

• Improved title detecting. skipped blank line.
• Fixed image reference option for fi/pi format

Index

• Debug pager problem in xmlconv
• debug lppv updater
• Updated ydocx

Debug pager problem

debugged slow login.

login is not solw.
Problem was loading all @transactions.

lib/xmlconv/state/transactions.rb

      def init
        @transactions = @model
        p @transactions.length
        @model = @transactions.reverse
        setup_pages
        @filter = Proc.new { 
          page
        }   
        super
      end

16844

I tried ODBA.cache.prefetch

NOTE

It works. but why?

org.yasuhiro.xmlconv.sandoz> transactions.first.odba_prefetch
-> true
org.yasuhiro.xmlconv.sandoz> transactions.first.odba_prefetch?
-> false

NOTE (before commit)

starting cleaning cycle
cleaned: 0 objects in 0.020137 seconds
remaining objects in @fetched:    86
remaining objects in @prefetched: 16849
remaining objects in ObjectSpace: 1397362
memory-usage:                     338MB

Updating of @transactions in execute at API also problem.

xmlconv/util/application.rb

  @transactions.push(transaction)
  ODBA.transaction {
    @transactions.odba_store
  }

updated like this.

  ODBA.transaction {
    transaction.odba_store
    @transactions.push(transaction)
    @transactions.odba_isolated_store
  } 

update odba_prefetch

org.yasuhiro.xmlconv.sandoz> transactions.map {|t| t.odba_prefetch = true; t.odba_store }
org.yasuhiro.xmlconv.sandoz> transactions.odba_store

update steps

1. . pull & reboot
2. . update odba_prefetch (see above)
3. . reboot

debug lppv updater

Now, http://www.lppa.ch/ does not have price data.

count lppv package.

result (online after update job)

ch.oddb> packages.length
-> 24874
ch.oddb> packages.select {|pac| pac.lppv == true }.length
-> 584

• total packages : 24874
• active lppv flag : 584

Updated ydocx