Scrapy Jobs

I need a one-time extraction of contact details from a UK-based website. The pages are publicly accessible, but they sit behind basic pagination and a search filter, so the process may require a crawler that can navigate multiple result pages before harvesting the data. Please capture the following items and export them to a single, tidy Excel workbook (.xlsx): • Email addresses • Phone numbers (normalised to +44 format) • Postal addresses A clean header row, one record per line, and the removal of duplicates are essential. Basic validation—such as checking email syntax and trimming whitespace—will save me time later. I’m comfortable if you choose Python with BeautifulSoup, Scrapy, or Selenium, or another language you prefer, provided the result...

I need a small application that checks a chosen info website every hour, captures any freshly posted content, and immediately publishes those findings inside a password-protected web portal. The exact data points we collect—new arrestee, charge , bond amounts, or something else—can be finalised together once development begins, but the program must recognise what is new since the previous run and avoid duplicates. The workflow I have in mind is straightforward: 1. An automated scraper (Python with BeautifulSoup, Scrapy, or a comparable solution is fine) runs on an hourly schedule. 2. Scraped items are stored in a lightweight database so they can be compared against previous runs and displayed chronologically. 3. A simple web interface, secured by login credentials, sho...

I need all publicly visible text, images, and product-specific details extracted from a single website and handed back to me in a clean CSV file. This is a one-off job, not an ongoing crawl, so the script only needs to run once—though I’d like to keep the code for my records in case I decide to repeat the process later. The CSV should include columns for every piece of information that appears on the product pages (titles, descriptions, prices, image URLs, SKU or ID codes, category paths, and any other attributes you’re able to capture). All referenced images must be downloaded as files and organised in a folder structure that mirrors the CSV paths. Key points • Accuracy matters: fields should align consistently across rows. • No duplicates or missing reco...