I need a scrapy-splash proficient developer

We have a small B2B business and one of our partners has a website with some sales and operational data that I want to scrape.

The site uses javascript and Ajax, I think, so the content requires management of __viewstate variables and making POST requests.

I have a simple working version that does some of the scraping and now want to extend it but have run into a skill bottleneck when it comes to dealing with the cookies and hidden state variables and collecting these after making changes to some form inputs (I have tried 'from_request' but haven't been able to get it to work).

The data itself can be taken from html tables or from an excel file if you can manage to get the API to respond.

I have two other sites that I am also scraping or wanting to scrape (one of which is very hard to deal with as uses an AMF message broker) so this might lead to other jobs and ongoing maintenance/modification requests.


Skills: HTML, Javascript, Python, Scrapy, Web Scraping

See more: i need a back end developer, i need a cheap app developer, i need a chrome app developer, i need a independent app developer, i need a ios app developer, i need a local ios developer in dallas tx, i need a mobile app developer, i need a stream box developer to upload andd play back videos on tv, i need a twitter software developer, i need freelancer android app developer delhi, i need hp service manager developer consultant, i need a darkrp server developer, i need a andriod application developer, i need a front end developer, i need an iphone app developer, i need a professional website developer, i need a quick web developer post ad, i need a transport software developer, i need a web application developer, i need freelance android application developer

About the Employer:
( 0 reviews ) Central, Hong Kong

Project ID: #19955849

Awarded to:


Hi, I am a professional crawler, I do with many website like that. I am using python scrapy, scrapy-splash, parser form, json ... Do, I can do it for you contact to me via chat to discuss. We will renegotiate the price More

$111 USD in 1 day
(3 Reviews)

16 freelancers are bidding on average $170 for this job


Hi James, I can help you to scrape websites in question including dealing with AMF and __viewstate's. please show me those websites so I can evaluate them.

$99 USD in 3 days
(249 Reviews)

I'm one of the best Scrapy experts here (check my reviews) that's why I'm sure you'll be impressed with my work. I can provide you a fast and effective Scrapy spider that will work with your target website. All I need More

$150 USD in 2 days
(395 Reviews)

Dear Sir. Glad to meet you. I'm very interested in your job post involving these skills. I'll bring your idea to the next level or extend your live project with new awesome features. I'm web Developer specializing in More

$200 USD in 7 days
(36 Reviews)

Dear, employer. My name is Lee, I am an experienced web developer, and web scraping expert. I have good experiences in web scraping using PHP, Python, Java and so on. I read your job description, and I am interest More

$144 USD in 3 days
(33 Reviews)

How are you? I checked your project description carefully and bid here. I have expertise in webscraping and completed many projects. I'd like to use python, php and js when I scrape website. I can complete your pro More

$150 USD in 3 days
(45 Reviews)

can handle with cookie and session along with post request params. want to know more about the website and data fields. can make automation of apis in Python. These are my skills related to web scraping and crawling More

$200 USD in 2 days
(44 Reviews)

Hi Employer, I can extract any data from any [login to view URL] I have scraped the data from these websites & stored scraped data into CSVs and excels as per my clients requirement. :- You can check these websites... More

$108 USD in 4 days
(17 Reviews)

Hello I can help you in scrapping website content and store in it database let's connect and discuss in details about it Thank you

$500 USD in 7 days
(16 Reviews)

Greetings, I need a scrapy-splash proficient developer Hi, First of all, I want to introduce my self I am Senior WordPress Developer, having 6 years of experience in WordPress Development & Plugins Development More

$250 USD in 4 days
(20 Reviews)

Hello, I have experience in web scraping with Python. I have experience with Scrapy and Splash to handle JavaScript, I can show you previous work ! I can also use Selenium, BeautifulSoup and Requests to make the More

$122 USD in 3 days
(2 Reviews)

Hi , Thanks for sharing your requirement .We can use python and specify the headers like useragent and _viewstate and we can make http api around your scraper meanwhile please have a word so we can discuss More

$30 USD in 2 days
(2 Reviews)

Hello there, Hope you are doing good...!!! As per your requirement, I am very much suitable for the job kindly invite me for a chat for further discussion regarding the project. I have more than 6 years of e More

$155 USD in 3 days
(1 Review)

am a Software Developer.I also have strong knowledge of the skills listed below: 1- C#, JavaScript, Asp(.)net, jQuery, Html, CSS. 2- Windows services. 3- Web services. 4- Windows Form Application, Windows C More

$140 USD in 7 days
(0 Reviews)

Customer's satisfaction is my goal *** Please explain in details what exactly u want me to do? *** Also 100% Completion is happy of me and client. *** *** Rest is my creative idea and honest effort. *** Lookin More

$155 USD in 3 days
(0 Reviews)

I know very well this type of scraping . I have already scraped this type of data and also I am scrap this type of data. I have scrape the big site like Amazon, Walmart, Kroger and Tmall and I have deliver 7 lakhs + More

$212 USD in 5 days
(0 Reviews)