RSS crawler for different languages and categories fetched from database

In Progress

I have mysql database where we need to feed it with news from RSS websites.

Considering the RSS links are in database, linked to categories and the categories are linked to countries so for example:

-USA

-- Politics

--- [url removed, login to view]

---- [url removed, login to view]

---- [url removed, login to view]

---- [url removed, login to view]

--- [url removed, login to view]

---- [url removed, login to view]

---- [url removed, login to view]

---- [url removed, login to view]

etc...

We need to create a well clean and clear pure PHP script based on PHP7 where it will read the RSS and insert them into the database in the table article. I will provide you with the database script where we have there the following tables:

===Database news

== Table structure for table article

|------

|Column|Type|Null|Default

|------

|//**article_id**//|int(255)|No|

|category_id|int(11)|No|

|language_id|int(11)|No|

|rss_id|int(100)|No|

|article_title|tinytext|No|

|article_date_time|datetime|No|

|article_details|text|No|

|article_image|varchar(255)|No|

|article_video|varchar(255)|No|

|article_page_name|varchar(255)|Yes|NULL

|article_importance_level|int(10)|No|1

== Table structure for table category

|------

|Column|Type|Null|Default

|------

|//**category_id**//|int(10)|No|

|category_name|varchar(255)|No|

|language_id|int(4)|No|

|category_color|varchar(10)|No|

|category_order|int(3)|No|1

== Table structure for table language

|------

|Column|Type|Null|Default

|------

|//**language_id**//|int(4)|No|

|language_name|varchar(100)|No|

|language_flag|varchar(255)|No|

|language_country_name|varchar(255)|No|

|language_order|int(11)|Yes|NULL

== Table structure for table rss

|------

|Column|Type|Null|Default

|------

|//**rss_id**//|int(100)|No|

|rss_link|tinytext|No|

|category_id|int(10)|No|

|language_id|int(4)|No|

|rss_frequency_minutes|int(4)|No|

Once we agree I will send you mysql script to create the database on your pc.

The script should crawl as well the video links, the images links, article title, description, etc.. (mainly everything in the table "article" should be filled by your script).

1- First script will be called from the cron job which will loop over the languages/countries (country and language are the same to us) and call the second script and pass for it the language_id as parameter.

2- Second script will be called from via the first script, get the language_id as parameter, fetch relevant categories from database, and foreach category, fetch the relevant RSS links and send each RSS link to a third script as request param.

3- Third script will take the rss link (should accept all kind of links like .xml and .rss) and will crawl the data, filter them and insert them into article (that's the objective here)

The scripts must be optimized for speed, comments should be on the code for easy editing later on, not too many nested function to avoid losing connectivity of the task, no frameworks should be used, just simple PHP classes, no complex OOP required, MVC is not needed.

The project should be done within couple of days from the moment we agree on.

I would like to see sample of the code via a hangout with the candidate.

Thank you.

Skills: MySQL, PHP, Software Architecture, XML

See more: software write mq4, software write chip epson, useful software write book, software write web specs, free software write user guide, database design web crawler, software write edid, free software write company profile, software write websites idea, rss page, software write book images, google maps database categories, joomla 500 server error rss page, software write books, add rss page, access database web page filter, software write protection, free software write book, joomla adsmanager database categories, joomla different front page registered, project database categories subcategories, software write book, different myspace page setups, google maps php database categories, web crawler copying web page

Project ID: #12228533

Awarded to:

bijaya47

Hello Sir Greetings of the day! I have gone through the project specification. I have prior experience with similar types of websites. I am a developer with 4 yrs of experience with wordpress, woo commerce, corep More

€238 EUR in 4 days
(95 Reviews)
6.1

14 freelancers are bidding on average €229 for this job

toseef3

Hello I have read your requirements and I am willing to do this project for you.We are an experienced team based in Pakistan, having 9+ years of experience in Enterprise, web and smartphone app development. We have More

€147 EUR in 3 days
(53 Reviews)
6.7
ITLove007

How Are You, Sir. I have mobile app( Android, IOS) , php and backend skill. I have experience with Social app, Dating app, Chatting app, Video Streamming, IPTV app, Uber style App , Restaurant/Food Deliver app, phot More

€631 EUR in 3 days
(36 Reviews)
6.4
ATLASFSD

A proposal has not yet been provided

€200 EUR in 1 day
(42 Reviews)
5.6
satvainfotech

Hello, We are expertise Team of Professionals having experience of more than 12+ years in IT Fields. We have very good exposure in .NET, WCF/WPF, MVC 4+, MSSQL, LAMP, PHP, MySQL, Wordpress, CakePHP etc.., We ar More

€277 EUR in 3 days
(15 Reviews)
5.6
FutureTechno1

Hi there, I’d like to be considered for your job position. I’m a Software Developer with a strong background developing web application. I can turn your requirement in a way that represents your brand and appeals t More

€155 EUR in 3 days
(8 Reviews)
5.2
pthreeinfotech

Hi...... I am Pritesh and I represent Pthreeinfotech. I can complete your project on time. I have worked on similar projects to what you are looking for, and I am confident I can exceed your expectations. I read throug More

€200 EUR in 3 days
(23 Reviews)
4.2
€388 EUR in 3 days
(6 Reviews)
4.1
webperfection123

EXPERT WORDPRESS DEVELOPER with 5 YEARS EXPERIENCE:: Thanks a lot for sharing the details regarding the project. I have completely checked the requirements and fully comfortable to work on your job . I am 100% Sure More

€188 EUR in 5 days
(9 Reviews)
4.1
hirakhan2

Hi,  I have review project details and would like to discuss with you regarding the project. Kindly let me know when available. Thank you.

€194 EUR in 7 days
(3 Reviews)
3.2
ArkssTech

Hello I have reviewed your job description as well and very confident to handle this project perfectly. I am expert in Web designing/developing.I believe that I can be the best productive candidate for this require More

€155 EUR in 3 days
(6 Reviews)
3.3
maheshinc

Hi I have been in this industry for 10 years and such jobs are my daily practice.I can assure you that if you work with me once, you will always work with me for these kind of projects.

€140 EUR in 7 days
(1 Review)
3.1
accreteinfo

Dear, The only confusion is with "article_importance_level" how will it be determine. Please share your convenient time to discuss project in details on hangout. We can finish this within 2-4 days. Hoping for yo More

€111 EUR in 3 days
(1 Review)
1.9
syncnologies

Hello Sir/ Ma’am, We have pool of dedicated team consisting of certified developers capable enough to handle your project exactly according to requirements and within said time frame. As per shared project de More

€122 EUR in 3 days
(1 Review)
0.5
MarshaMalone

Hi Marsha here, I hope you will consider me for your project. I will assure you a quality end product at a competitive price. I know you will be swamped with bids so thank you for the time. Hoping to hear from you soon More

€222 EUR in 1 day
(0 Reviews)
0.0
ludzbunet2016

Hello there , if you are looking for dedicated team of experts in this area we are available to work on your projects. Feel free to contact us in private for further details. Our Sk.Ype id : gag0qqq Thanks & Ki More

€200 EUR in 3 days
(0 Reviews)
0.0