Python- Loops, data, csv

Scenario: Website has 100 categories, and roughly 50 amount of pages in each category. On each page, I'll be taking names. I have already created a working system that gets users from the first page, I need help with looping it to the next page, and than the next category when pages are ended for that category. From there to save all names to a .csv file column. Than we can remove the duplicates.


category = 1

page = 1

web = ("wget [url removed, login to view]" + category + page)

output = [url removed, login to view](web)

names = [url removed, login to view]('name=')[1:]

for i in names:

print([url removed, login to view]('">')[0])

if [url removed, login to view]("[url removed, login to view]") == -1:

print "Set loop to go to next page"


print "End of category pages, continue to next category.."


^sample code, will not work as is but gives you a great idea.

Need someone who is proficient in python. If you can multi thread this be faster, let me know also.

Skills: Linux, Python

See more: python programming loops, python csv data processing, import csv data sql express 2005, mysql update csv data, csv data feed creator, import yellowpage csv data, excel chart provide csv data, csv data feed web page, csv data compiler, create invoice import csv data, csv data capture, website csv data feed reader, mysql read delimited csv data, csv data dating profiles, import csv data sql server table, convert php python, modules python, python system programming, python client google apps, python twisted ldap, python hmi, stock control python, php create table csv data, python parse file database, email feedback loops

About the Employer:
( 15 reviews ) New Jersey, Canada

Project ID: #14083327

Awarded to:


Hi I have years of python experience and have done some big projects that require multithreading. I can help you accomplish your goals and get everything working exactly as you want it. If you want to know more about m More

$15 USD in 1 day
(1 Review)

22 freelancers are bidding on average $34 for this job


I can create fast and efficient threaded Python spider for you. Just give me target site URL and output you want. Thanks. Roman

$55 USD in 1 day
(119 Reviews)
$70 USD in 1 day
(30 Reviews)
$40 USD in 1 day
(29 Reviews)

can loop through pages , and can make multithreaded version either. But I have to look what you have there already, and check out target website for this tas.

$60 USD in 1 day
(19 Reviews)

hello I have read your requirement. I can help you to finish this work. Can you provide more information about this project? Thank you

$50 USD in 1 day
(17 Reviews)

I understand about your requirements. I have 5+ years of Python, PHP programming experience. I think I can do your work perfectly. If you choose me, I will finish it in time and do my best. I will provide you one m More

$30 USD in 1 day
(8 Reviews)

i am post doc research my research area is about computer vision and robotics, I am expert on python, i have many academic papers about it. you can check my google scholar page here is [url removed, login to view] More

$30 USD in 1 day
(7 Reviews)
$25 USD in 1 day
(3 Reviews)
$25 USD in 1 day
(16 Reviews)

Hey We are a team of Technical Developers and have got expertise in such stuff. Ping me if you are looking for a quick resolution

$35 USD in 1 day
(3 Reviews)

Hey there, I am willing to work on this project. More discussions over chat. "I can start work right away." Thanks for looking forward to my proposal.

$34 USD in 1 day
(2 Reviews)

i have already worked for multithreaded content fetch from the websites. The application will provide an easy interface for the project holder

$25 USD in 2 days
(1 Review)
$25 USD in 1 day
(0 Reviews)
$25 USD in 1 day
(0 Reviews)
$55 USD in 2 days
(0 Reviews)

I can give it a try. I like to do this type of work. And I will also try to optimize the solution for you....

$25 USD in 1 day
(0 Reviews)

Hi I am Zubair, expert in web scrapping, Data mining, and web research. I have gone through your project and I am interested in your project. We can have a detailed discussion on the project over chat… Thanks and Rega More

$10 USD in 1 day
(1 Review)

A proposal has not yet been provided

$35 USD in 15 days
(0 Reviews)

Dear Sir/Madam, Confident in this project. I am experienced in Python and i have a lot experience for parsing data into excel spreadsheet. Thanks,

$25 USD in 1 day
(0 Reviews)

sir i worked on many python assignments and projects i can do this task easily if you hire me please. thanks hi7

$25 USD in 1 day
(0 Reviews)