The script should
- connect to mysql database
- table = domains_to_crawl
- it should select all domains that haven't been crawled.
- then crawl those domains and return any other NEW domains it finds.
- store those new domains in database to also be crawled.
- the lamda function should run indefinately whenever there are new records or uncompleted records in the database that haven't been crawled yet.
fetch domains from db -> crawl each domain -> store any new domains found -> crawl those domains -> automatically run whenever there are domains in db table so it needs to run indefinitely.
EXPLAIN THE JOB TO ME SO I KNOW YOU UNDERSTAND
3 - it should store every domain it finds in aws rds database.
BIDS OVER $50 WON'T BE HIRED.
8 freelancers are bidding on average $100 for this job
Hello, I have read your job details carefully and i can do your work if you will provide me more details of project.I will definitely give you a best solution to your problem. Thanks