Data Entry and Database Creation

In Progress

I currently download approx. 5 excel files a day containing ~ 80 rows of data and a few hundred columns. I then paste these files into a master file containing the last 3 months worth of data.  

I also have a second spreadsheet containing different information, a few columns of which I add to the first spreadsheet by doing lookup formulas on the name and date field.  

As you can imagine, this file is now very large, making the many formulas I use for analysis very slow to update.

The project I am looking to get done involves:

1) Download the approx 5 csv files per day required for the first mentioned spreadsheet for the previous 3 years, by visiting a website that stores this information on a 1 web page per day basis. The best method I have found is a simple Google Chrome add in that downloads all csv's on a given page, once opened, but I am sure there is a faster solution;

2) Combine into one excel file. i have VBA code that can do this automatically available to you if needed;

3) Add columns and combine with the second spreadsheet mentioned above. I will provide the second spreadsheet so no downloading is required. I will make the formulas used to combine the files available to you, and I will check through the results once this step is done as I anticipate some errors due to incorrect data in the source sheet.

4) Insert 10-20 new columns filled with formulas I will provide and let excel calculate.

5) Take this final spreadsheet (or maybe a few spreadsheets due to number of row constraints in excel) and turn it into a queryable database, such as an access database, as I have this software.

I am not sure if this is possible, but any Freelancer that can suggest a solution for task 5 that is queriable using excel formulas, or involves a solution that keeps the database in excel but removes much of the slow formula calculation time that exists for files of this size, will be looked at favourably. The reason for this is that I am fluent in excel but have no access database experience.

Many thanks. 

Skills: Data Entry, Microsoft Access, Web Scraping

See more: web scraping with vba, web scraping solution, web page data entry, web data scraping freelancer, web creation freelancer, vba spreadsheet scraping, vba get web page data, vba freelancer excel, simple scraping software, master of excel freelancer, last update for freelancer, in which field i can freelancer, google web creation, google sheet freelancer, google lookup spreadsheet, get web page data into excel using vba, freelancer worth, freelancer website creation, freelancer web master, freelancer vba access excel, freelancer lookup, freelancer last update, freelancer insert data, freelancer in chrome, freelancer google chrome

Project ID: #5164241

Awarded to:

mail2vimalarora

Hi.. I have gone through your requirement in the project of consolidating data into one excel at the last. However, I will suggest for point 5, to store all database in MS Access and link excel to access database to sh More

$188 AUD in 7 days
(8 Reviews)
3.4

15 freelancers are bidding on average $177 for this job

Dhruvika111

Dear willpclarke, Greetings! Yes it is possible through MS Access,if you require we are able to provide you small demo set. For your reference I have attached a copy of our brief work portfolio with this mess More

$105 AUD in 2 days
(134 Reviews)
7.1
uumairkhalid

Hi.. Expert web scraper/Data Minor here. Interested in your project. I assure you 100% accurate and good quality work. I have too too scraping experience. let me know if you want sample before awarding. lets start. Reg More

$152 AUD in 10 days
(78 Reviews)
6.1
dpune

Hi, I have more than 14 years of exp and I am expert in this kind of work. I have completed more than 200 projects. Please look at the feedback left by my employer to know more about my work. Waiting for your positive More

$166 AUD in 10 days
(73 Reviews)
5.5
best4best

I am an Excel expert. In the first step I have to download data for 3 years (around 5475 files = 5 per day x 365 days x 3 years). Will these be downloaded one-by-one?

$250 AUD in 5 days
(80 Reviews)
5.5
amcsummers

Welcome to Freelancer! There are a lot of good coders out there. Freelancer asks everyone to review the people they work with after every project. This will give you some insight on what to expect from the person you a More

$177 AUD in 10 days
(43 Reviews)
5.4
danielgpratidya

Hi, Very interesting project. 1. To download those csv files I have a downloader tool (an .exe file), all you need is to enter the page's url and define the target folder to store those downloaded files. 2. I can More

$100 AUD in 2 days
(39 Reviews)
5.2
flashsaiful

A proposal has not yet been provided

$152 AUD in 10 days
(33 Reviews)
4.5
gillian1607

Propunerea nu a fost încă furnizată

$100 AUD in 5 days
(11 Reviews)
4.4
elboukharimu

Hi, I'm very interested helping you creating your Access database, I have more then 7 years of experience in SQL and database administration, modeling, and manipulating, please do not hesitate to check my portfolio, th More

$242 AUD in 10 days
(5 Reviews)
3.8
gondreus

Hi, To be honest I'm half understand about your goal here, let me explain and I might come up a solution for you to makes your life easier. Based on your requirement: 1. Download 5 files a day, is it a csv or xl More

$277 AUD in 10 days
(1 Review)
2.4
ibisREDibis

G'day from the motherland :) I would like to discuss this project with you further via the freelancer messaging system. Please can you send me a message. Kind regards, Daniel

$140 AUD in 5 days
(2 Reviews)
1.8
nawazwasif

Respectable Sir, My name is Muhammad Nawaz. I have spent 16 years of experience in IT field. But on Freelancer.com it will be my 13th project. My services are in internet campaigning, managing emails, contacts, researc More

$277 AUD in 15 days
(1 Review)
0.0
masevega1

A proposal has not yet been provided

$161 AUD in 10 days
(0 Reviews)
0.0
shantanumit

A proposal has not yet been provided

$161 AUD in 10 days
(0 Reviews)
0.0