Find Jobs
Hire Freelancers

Web Crawler for University Policy Documents

$30-250 USD

Closed
Posted about 2 months ago

$30-250 USD

Paid on delivery
I'd like a web crawler that can go out to a list of US university websites and find documents (or pages) that describe certain aspects of university policy. I'd like the documents labeled and organized in a folder. I will provide a set of likely keywords and the domains to be searched. The domains will be provided in a spreadsheet containing university names and homepages. There are approximately 3000 domains to be searched. The keywords will be samples and may not be the exact names of the policy. A flexible search is required. A successful project will return the academic integrity or misconduct policy for each university as a PDF along with a link to the original document online. Note: this is part of a research project for a university professor.
Project ID: 37812967

About the project

20 proposals
Remote project
Active 14 days ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
20 freelancers are bidding on average $129 USD for this job
User Avatar
Greetings! As a skilled web crawler expert, I have the experience and know-how to complete your project with efficiency and accuracy. My expertise lies in creating custom web scraping tools, and I have successfully completed a similar project for a client who needed to gather data from various university websites. I am confident I can achieve the same for you. To ensure your satisfaction, I will provide a detailed and organized folder containing PDFs of the academic integrity or misconduct policies for each university, along with links to the original documents online. This will be done by utilizing your provided list of 3000 US university websites and a set of likely keywords to conduct a flexible search. Before starting, I have a few questions for you: 1. Are there any specific formats you would like the PDFs to be in? 2. Can I have a sample list of keywords to optimize the search process? 3. Would you like the PDFs to be labeled with the university name for easier organization? 4. When do you need this project to be completed? I am eager to work on this research project for the university professor and deliver the desired results. Thank you for considering my bid. I look forward to discussing further details with you. Best regards, George
$500 USD in 3 days
5.0 (85 reviews)
7.9
7.9
User Avatar
Hello! Efficient web crawler specializing in US university policies. With a tailored list of keywords and 3000 domains provided, our solution will meticulously label and organize relevant documents, ensuring a comprehensive and organized repository for easy access and analysis. Thank you-
$120 USD in 3 days
4.9 (269 reviews)
7.3
7.3
User Avatar
Top 1% in Freelancer.com Hi, Greetings! ✅checked your project details: ✅Completed Time: In project deadline We have worked on 900 + Projects. I have 6 + years of the experience in same kind of projects. If you are looking for a true Freelancer, I am the Right person for you. I am available almost 24-7 and am very responsive. I feel proud that I am a trusted Freelancer who pleases almost every single client. You can rest assure, your work will be delivered well in advance of others, with passion and accuracy. I guarantee you instant communication & responses when you need me. Why choose me? I think every client is the reason for my success. I only take projects which I am sure I can do quickly. My Portfolio Items: https://www.freelancer.com/u/schoudhary1553 I would really like to work with you on this project. If interested, Kindly contact me via chat for further details and discussion. Thank you Sandeep
$180 USD in 4 days
4.9 (68 reviews)
6.8
6.8
User Avatar
Hello there! It is great having you post your project on this platform on Web Crawler for University Policy Documents. I am an ardent researcher and content developer. I will be glad to assist you in this project to achieve your strategic project milestones. Kindly send me a private message to take our discussion further. You can also check my profile to see other employers’ comments about me: https://www.freelancer.com/u/ayowealth Thanks in anticipation Ajayi!
$30 USD in 1 day
4.8 (47 reviews)
5.7
5.7
User Avatar
Hello dear, I am a professional writer with over 9 years of experience in the field of writing. I am a professional in providing high quality writing service. I am interested in this project. I have completed many similar projects before. You’ll find my content as 100% unique, grammatically correct, engaging, and of high-quality. I am confident that I will be able to lend my talents to you in this way. I have also a good experience in article writing, research writing, copy writing, blog writing, business plan, marketing plan, case study, Financial analysis, Power point presentations, writing tasks, Essays, Proposals, Rewriting tasks, Technical Reports, financial plan. I can deliver your work according to your requirements. I can deliver high quality work with tight deadline. Hopefully, I get this opportunity to work with you as I am sure it will be a good working experience. Kindly come on chat for detailed discussions. I will complete your job as soon as possible. Thank you.
$30 USD in 1 day
5.0 (55 reviews)
5.1
5.1
User Avatar
Hey sir, it seems that you want to scrape some data about universities' policies from each university domain and extract it. We can scrap any data from any website or automate a website easily using Python libraries such as Selenium for automating websites and scraping data or Scrapy, which allows us to create a spider for scraping many websites in the same criteria or algorithm. Then we can export data to an Excel sheet, PDF, or a database using Python. Can you just share the websites with me so I can check the structure of them? I have just finished 2 projects of scraping data, one of them was to scrape around 600k products from Sunsky-online using their own API, and then upload it to a Shopify store, and the other one was scraping almost 2.2 million products from 10 websites for a customized dropshipping website. check please >>> https://www.freelancer.com/projects/data-processing/Pls-READ-carefully-Scrapping-Shopify/reviews I’m a data analyst and Python developer with 3 Nanodegrees in data analysis from Udacity. I worked on several projects related to Python programming, one of which was to investigate the TMDB movies dataset. I will be pleased if you contact me to work together, waiting for you, thank you.
$30 USD in 1 day
4.9 (13 reviews)
4.5
4.5
User Avatar
Hi sir, I can help you in scraping pages that describe certain aspects of university policy I have experience in python with selenium, BeautifulSoup and website Api, I provide high accuracy and quality. I did many successful projects like that before. You can see my profile : https://www.freelancer.com/u/abdulrahman545
$90 USD in 2 days
5.0 (25 reviews)
4.1
4.1
User Avatar
Respected learned Client, I understand your are seeking a freelancer to fishout specific policy related to academic intergrity misconduct with documents being labeled, organized and saved as PDFs along with the links to the original documents online. I am capable to carry out this project beyond your expectations. As an experienced university administrator with a background in web crawling, I am well-equipped to undertake this project with precision, accuracy, and timely delivery. While I may be new to Freelancer.com, my expertise in web crawling ensures that I can meet all project requirements effectively. I will diligently search through the provided list of 3000 domains of US university websites using the specified keywords, ensuring flexibility in the search to capture relevant policy documents. Each document will be meticulously labeled, organized, and saved as PDFs, accompanied by links to the original sources online. My commitment to excellence in research, web scraping, internet research, and web crawling guarantees a high-quality outcome. I am dedicat ed to delivering results that exceed expectations and contribute to the success of your research project. Thank you for considering my proposal. I am eager to apply my skills and contribute to your project's success.
$225 USD in 7 days
5.0 (1 review)
0.8
0.8
User Avatar
Hey, David R., I went through your project description and it seems like I am a great fit for this job. I am a good and reliable man who has many years of experience on Research, Web Scraping, Internet Research, Web Crawling. Please come over chat and discuss your requirement in a detailed way. Regards
$140 USD in 7 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Hi there! I totally understood your request and i have relavant experience working with all python automation tools Selenium, BeautifulSoup and Pupetteer and I can deliver this project in the given timeframe and ready to extends working hours too. Let's discuss more in details.
$130 USD in 7 days
0.0 (0 reviews)
0.0
0.0
User Avatar
I read your project details, I have 13 years experience on your project. I can do it very easily Already i completed some projects like this. Just a Close your eyes and Trust me. I am sure, you will be happy
$39 USD in 2 days
0.0 (0 reviews)
0.0
0.0
User Avatar
With my expansive skill set encompassing internet research and web scraping, I am in a prime position to fulfill and even exceed your project's requirements. Having honed these skills over four years, I understand the intricacies of extracting valuable data from sprawling websites. As part of your project team, I will ensure that all 3000 university websites are methodically crawled through, recording and organizing each university policy document that matches or relates to the given keywords. Through my experience in crafting captivating online experiences, I have learned to be adaptable and innovative in my approaches. While the keywords might not always be the exact names of the policies, this will not pose a challenge for me. On every search, I'll employ a flexible approach aiming to capture all relevant documents in line with the given keywords. Having a client-centric approach means that your goals are my number one priority. In line with this, any input you provide during the project's timeline will be highly regarded as it will shape every stage of the process; till we deliver each academic integrity or misconduct policy for every university as labeled PDFs along with the original document links online on time. Let's collaborate; together we can make significant strides in your research project for your university professor and raise your research value through quality output. Looking forward to being part and adding value to your project!
$30 USD in 1 day
0.0 (0 reviews)
0.0
0.0
User Avatar
Greetings! I am Qaisar and I am excited to submit my proposal for your project on Freelancer.com. With a strong background in data entry and lead generation, I am confident in my ability to meet and exceed your expectations. This proposal outlines my understanding of the project requirements and how I plan to deliver high-quality results. "I’ve carefully checked your requirements and really interested in this job I’m offering best quality and highest performance at lowest price. I can complete your project on time and your will experience great satisfaction with me.I have rich experienced in Research Web Scraping Internet Research Web Crawling and Data Entry. "
$30 USD in 2 days
5.0 (1 review)
0.1
0.1
User Avatar
I m professional content writer garphic designer video editor I like writing work graphic designer and content writer
$140 USD in 7 days
0.0 (0 reviews)
0.0
0.0
User Avatar
I propose to develop a custom web crawler tailored for your specific needs. The crawler will be capable of searching through the provided list of 3000 US university websites for documents or pages related to academic integrity or misconduct policies. Using a combination of the provided keywords and a flexible search approach, the crawler will locate and download the relevant policy documents. These documents will be organized and labeled appropriately in a folder structure for easy access and reference. Additionally, the crawler will capture the URL of the original document online, providing a direct link to the source for verification and further research purposes. I have experience in developing web crawlers for my assignments and projects and scraping tools for similar research projects, and I am confident in my ability to deliver a solution that meets your requirements effectively and efficiently.
$140 USD in 7 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Saya orang yang komitmen, dan sangat idealis, saya mampu menyelesaikan project tepat waktu dan siap menerima penyesuaian bahkan revisi
$140 USD in 7 days
0.0 (0 reviews)
0.0
0.0
User Avatar
I'm used to collecting data for research materials for a short period of time but still prioritizing the credibility and content of the sources used. The most recent experience, I've written a 10-page report in less than four hours.
$140 USD in 3 days
0.0 (0 reviews)
0.0
0.0

About the client

Flag of UNITED STATES
Owasso, United States
0.0
0
Member since Feb 26, 2024

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.