Paging and Selecting with XML in R

  • Status: Closed
  • Prize: €35
  • Entries Received: 5
  • Winner: kluczyn

Contest Brief

The R-code attached scrapes data from a XML-page. However, it only catches the first 50 entries of a total of over 36000 entries, distributed over 790 pages.
The OS-environment is Windows.

--> Find the cleanest and most elegant solution for two problems:
1. Catch all entries and overcome the paging mechanism.
2. Catch all entries where updated is beween january 1st 2016 and may 25th 2017.

Send your file via PM to me. I am looking forward to your solutions!

Recommended Skills

Public Clarification Board

  • mattsrinc
    mattsrinc
    • 6 years ago

    This is not a self embedded R script - it doesn't state all required packages at the beginning. And then it errors on the XML file etc. Once you have that fixed, I might be able to help you more.

    • 6 years ago
    1. mattsrinc
      mattsrinc
      • 6 years ago

      I've meant the required libraries. It's OK, finishing my solution that completes faster than others and will upload it soon.

      • 6 years ago
    2. mattsrinc
      mattsrinc
      • 6 years ago

      Well, slightly disappointed with the choice of winning solution (in my experience having a solution with functions always gets more points) but congratulating the winner to use plain XML and some possible pausing between server requests. Still believe functions, using a while loop and working with JSON is more correct and easier to maintain/enhance.

      • 6 years ago
  • mirevich
    mirevich
    • 6 years ago

    Hello,
    Would you like to make public R-script in entries or send it in private messages?

    • 6 years ago
    1. labuta
      Contest Holder
      • 6 years ago

      Thank you! Yes, please send it to me via PM.

      • 6 years ago
    2. mirevich
      mirevich
      • 6 years ago

      I can not sent you message, maybe you need to write me first. Thank.

      • 6 years ago

Show more comments

How to get started with contests

  • Post your contest

    Post Your Contest Quick and easy

  • Get tons of entries

    Get Tons of Entries From around the world

  • Award the best entry

    Award the best entry Download the files - Easy!

Post a Contest Now or Join us Today!