Data Mining, Programming, DBA

ISO of season programmer/DBA for data scrapping and data collection.

What I need: - Mine users from various social networks in an organized and structured format using non API strategies. ex: if the user has their Facebook account and open to the public vs users w/higher restrictions. Names, places, etc... must be stored in a DB in an organized (on-the-fly) fashion especially since different social networks provide different datasets. - compare user datasets and provide a clean user dataset with 95% accuracy or higher - DB should be well structured and maintained. Speed of receiving the data is essential therefore DB should be efficient and every millisecond counts. Therefore data should be small and fast.

Broad Strokes - Scrap data from Social Networks - Clean data to create one unique dataset of users. - store in DB with the purpose of retrieving large datasets fast and efficient. ie. 10gigs of data compressed and ready for d/l. Required - know the in-and-outs of the most popular social networks in the US. such as facebook, google, snap, instagram and be able to scrap data from the app directly. - programming to match datasets to create unique datasets. - experience DBA who understands format/structure and compression.

If there is existing code for scrapping than please provide me with the facts and how you can modify the code to be able to improve upon its collection functionalities. I have searched the internet and found a lot of scrapping code. We can use the tools provided to us by the internet and not recreate the wheel. Please be honest and fast with your work.

I am searching for a professional who has experience with this topic and able to speak daily either on the phone or msg. Don't be difficult. Thank You .

Answer these questions: - how many Data Mining projects have you worked on? -

please provide me with three of the most exhaustive data mining YOU completed.

What was your actual role?

- Do you have a data mining program?

- How would you data mine Facebook?

- What type of data will be mined? be specific.

- How would you clean up the data? be specific.

- How would you store the data? in what format? and the reasons for the selection

- How would the data be encrypted, compressed, and downloaded? whats the encryption, compression, and speed for d/l of 10gigs via a cable connection.

- How is the data presented? etc... T

Those with true knowledge can answer these questions in detail. Please help me decide to select you with knowledge of developments.

Skills: Data Mining, Data Processing, Database Administration, Hadoop

See more: data science, data scientist, data science career path reddit, big data analytics for healthcare journal, dba vs data scientist, data scientist career progression, data analyst career progression, careers in data mining, data processing, database administration, data mining, hadoop

About the Employer:
( 0 reviews ) Nowhere, United States

Project ID: #18168022

9 freelancers are bidding on average $1123 for this job


Hello, Hope you are doing well. I can help with you in your project Data Mining, Programming, DBA. I can assure you the quality job. I have good experience in Data Mining, Data Processing, Database Administrat More

$1500 USD in 20 days
(174 Reviews)

Hi there, I have checked the details I have rich experienced with Data Mining, Data Processing, Database Administration, Hadoop. Please initiate chat so we can discuss this job.

$1250 USD in 20 days
(2 Reviews)

I am expert web scraping. I can do your job with BS4 and Seleinum framework of python. I can store data into csv or xlsx file. I can scraping image, video, text, url, meta data etc.. Credit is my motto. I can compl More

$1111 USD in 20 days
(1 Review)

"Hi Dear, I’m an efficient data entry worker. I’m familiar with Google docs spreadsheet and I’ve experienced about collecting data from websites and enter into Excel and Google docs spreadsheet. I would love to tell More

$750 USD in 20 days
(9 Reviews)

Hello, I'm John, I can provide you perfect work as you looking for . we can discuss more in chat . I will be waiting for your response . I have very great experience about your project , if you want discuss more p More

$1250 USD in 7 days
(0 Reviews)

hi dear. i read your description carefully. i have a good experience for your idea. so i bid to you. please contact me, then you can check out me for your idea. thank you. best regards.

$1250 USD in 20 days
(0 Reviews)

I have necessary scripts to do data scripting. I have attached screenshot work below of Building, Supporting, and troubleshooting Linux Systems and setting up KVM environments. Screenshot link: More

$1000 USD in 5 days
(0 Reviews)

Hi there I've worked on several data mining and scraping projects, technical and academical, i've worked on data mining and text mining algorithms (NLP), scraping data from twitter and other webistes and even discord, More

$750 USD in 10 days
(0 Reviews)

Hi, I have full experience and expertise knowledge about web scraping, web bot using python and chrome extension. And I know well web socket, packet analysis and initialize cookie, change mac addr, ... technologies rel More

$1250 USD in 20 days
(0 Reviews)