Completed

a little PHP help

I have a script that scrapes data from a website...

They have recently change the code to only allow 50 results per page SO now I am having issues getting to the second page of data.... please adjust my code to get the second page of data...

current code:

$curl = curl_init();

curl_setopt($curl, CURLOPT_SSL_VERIFYPEER, FALSE);

curl_setopt($curl, CURLOPT_HEADER, 1);

curl_setopt($curl, CURLOPT_POST, false);

curl_setopt($curl, CURLOPT_RETURNTRANSFER, true);

curl_setopt($curl, CURLOPT_USERAGENT, "Mozilla/5.0 (Windows; U; Windows NT 5.1; pl; rv:1.9.1.2) Gecko/20090729 Firefox/3.5");

curl_setopt($curl, CURLOPT_FOLLOWLOCATION, true);

curl_setopt($curl, CURLOPT_COOKIEFILE, $cookie_file);

curl_setopt($curl, CURLOPT_COOKIEJAR, $cookie_file); // SAME cookiefile

$fromday = date('d', strtotime(' -0 day'));

$frommonth = date('m', strtotime(' -0 day'));

$fromyear = date('Y', strtotime(' -0 day'));

$today = date('d', strtotime(' -0 day'));

$tomonth = date('m', strtotime(' -0 day'));

$toyear = date('Y', strtotime(' -0 day'));

$todayDate = date('m/d/Y', strtotime(' -0 day'));

$todayDate1 = date('Y/m/d', strtotime(' -0 day'));

echo $url = "[login to view URL]$frommonth%2f$fromday%2f$fromyear&ReleaseDateEnd=$tomonth%2f$today%2f$toyear&matches=50";

curl_setopt($curl, CURLOPT_POST, true);

curl_setopt($curl, CURLOPT_POSTFIELDS, $postdata);

curl_setopt($curl, CURLOPT_URL, $url);

$html = curl_exec($curl);

$html = preg_replace('~>\s+<~', '><', $html);

//get DCNumber for each inmate

preg_match_all("/DCNumber=(.*?)&TypeSearch=IR/", $html, $DCmatch);

$totalcount = count($DCmatch[0]);

Skills: PHP, Web Scraping

See more: php disallow java script, php file uploader script, php news comment script, php forwarding emails script, php asp mail script, php shoppingcom api3 script, php video resize script, free php enquiry form script web site, ajax php drag drop script, php web scrape script, php uplad zip script, php video upload script, php video gallery script, php email oscommerce script, create php link dump script, php word count doc file script

About the Employer:
( 93 reviews ) Newnan, United States

Project ID: #20446681

Awarded to:

gangabass

I can fix your current PHP scraper in less than two hours for just $25. It will process each Next page until the end and parse results.

$25 USD in 1 day
(455 Reviews)
7.4

23 freelancers are bidding on average $26 for this job

moonwebtech

Hello, I read your requirement carefully and bid here. I can fix your PHP curl script in a few hours. As you can see my profile, I am a professional PHP developer. And I worked as a freelancer more than 8 years. Pleas More

$35 USD in 1 day
(224 Reviews)
7.4
sunnysmile911

Hi I read the project description and it seems to be an hour or less work. I am a senior full-stack web developer with 5+ years of experience. I built many websites using PHP based frameworks. Here are the websites I b More

$30 USD in 7 days
(32 Reviews)
6.5
shihan033010

Hi i am interested in your project. I am expert in php. Please give me the opportunity to start the project. Thanks Shihan

$30 USD in 1 day
(311 Reviews)
6.8
elbruninh

Hi, i'm interested but the $postdata var is missing in your code, can you check? if so, can you send me the full source code? i can do it regards [login to view URL]

$35 USD in 1 day
(101 Reviews)
6.5
webcast

Hello sir, I am good at : 1. WordPress, Shopify, Magento, Opencart, Joomla web development 2. PSD to HTML 3. Responsive web development 4. Graphics Designing 5. Photoshop 6. PHP 7. html + CSS Styling 8. js & jQuery. More

$30 USD in 1 day
(96 Reviews)
5.5
webfastsolution

Hi Sir, I will adjust you script to get second page data with loops with quality work. Sir i will start work immediately and complete within few minutes. Thank you

$15 USD in 1 day
(47 Reviews)
5.1
BlackEagle86

Hi I am available to do your project and very interested. Your required task actually map on my skill sets. As I am PHP, Scraping Expert, I can say that I can do it perfectly I want love to do this with full dedication More

$20 USD in 7 days
(8 Reviews)
5.1
sherazm

I can do this task. i have worked on many projects like this. ping me for more details and also check out my reviews. thanks

$15 USD in 1 day
(21 Reviews)
5.1
CreativeExpertIT

Hello Sir, In first reading it would start working after change below line [login to view URL];Page=List&amp;DataAction=Filter&amp;ReleaseDateBeg=$frommonth%2f$fromday More

$30 USD in 1 day
(45 Reviews)
4.9
yousufkhan39911

I have read the description and I can fix the script of data scraping as per your requirements. I can do it asap.

$29 USD in 1 day
(61 Reviews)
4.6
khoadeveloper

Hi, Dear client. I am a web scraping/automation/bot/chrome extension expert with 6 years of experience in NodeJS, Puppeteer, Chromy, Selenium, Chrome-extension, Chrome-headless, Firefox-headless, SilmerJS, PhantomJS, More

$30 USD in 1 day
(3 Reviews)
4.1
TopDesigner315

Thank you for your post, sir. I have a good chance of bidding your project. I have good experience of data scraping from some websites. For example, from Amazon site, I have ever scrapped the products. Such as name, pr More

$50 USD in 7 days
(9 Reviews)
3.9
Scorpius1116

Hi !!! Nice to meet you. Web Site / Web App development Expert here I have gone through the complete job description and placed bid accordingly. I am really confident in this part. This is what I have alre More

$20 USD in 2 days
(4 Reviews)
3.9
rishuwork17

I am AWS, Azure and google cloud certified server and Linux expert having 5 years of experience on migration of web application. I have good hands on Cpanel and server migration and LAMP deployment like Wordpress, mag More

$20 USD in 1 day
(20 Reviews)
3.6
BestService222

Dear client, how have you been? I've read your project description carefully. I am a excellent Full-Stack Web development expert. I think your project is very suitable for me. I 'm very interested in your project. More

$30 USD in 2 days
(11 Reviews)
4.3
bharatpraj

Hello, I'm Bharat I'm interesting your project very well I'm good in Website Design,PSD TO HTML HTHML, CSS , JAVASCRIT, JQUERY, AJAX, PHP, Wordpress,Codeigniter,laravel and mysql expert. I’m quite well experienced More

$10 USD in 1 day
(8 Reviews)
2.5
xueqingdba

Hello. I have seen the above requirements. The code is about api request to scrape data needed. That code doesn't redirect to new page correctly. Only a few lines of code are needed. I can finish it in 5 mins surely. More

$30 USD in 1 day
(1 Review)
2.5
shankarkanasecse

Hello Sir, I am interested in your job. I have good experience on PHP, CURL,Wordpress, Codeigniter, HTML, CSS, MySQL. I have worked on lots of Scrapping applications. I can work for you in less price with good qualit More

$20 USD in 2 days
(0 Reviews)
0.0
tophatindore

Hello, As per the requirement for the job post and also gone through your mention points. I am confident enough to work on this. I can deliver the best. As I am having 5+ years of experience in UI/UX. I am well verse More

$20 USD in 7 days
(0 Reviews)
0.0
pratikpatel4057

hi, I have 2+ years of experience I php and it's framework like codeignitor and laravel and yii and other. I can fix that for you.

$25 USD in 2 days
(0 Reviews)
0.0