StubHub Web Scraping Website--

I need to build a tickets site that scrapes the results from Stubhub. It will be very similar to [login to view URL], [login to view URL], [login to view URL], [login to view URL], [login to view URL] etc. The primary differences will be: 1. I will only scrape results from Stubhub and no other ticketing sites (for now- I need the ability to add other ticketing sites at a later point) 2. I will display the price of the ticket in dollars above or below my expert value (i.e. what I think the ticket is worth). So if a ticket is worth $50 in my opinion and it is selling for $55 on Stubhub, I will want to display it as $5 over what I think it is worth If it selling for $45, I want to display it as $5 less than what I think it is worth. So you essentially need to mimic the above sites but you will have to compare the scraped data versus a local database of "my value" for each seat type and compute the amount the scrapped data is over or under "my value". You also need admin tools for me to designate pricing schemes to compare the crapped data and for me to make particular events live on the site and active to be scrapped. ## Deliverables I need to build a tickets site that scrapes the results from Stubhub. It will be very similar to [login to view URL], [login to view URL], [login to view URL], [login to view URL], [login to view URL] etc. The primary differences will be: 1. I will only scrape results from Stubhub and no other ticketing sites (for now- I need the ability to add other ticketing sites at a later point) 2. I will display the price of the ticket in dollars above or below my expert value (i.e. what I think the ticket is worth). So if a ticket is worth $50 in my opinion and it is selling for $55 on Stubhub, I will want to display it as $5 over what I think it is worth If it selling for $45, I want to display it as $5 less than what I think it is worth. Beyond mimicking the basic functionality of the above mentioned sites, I will need the following additional backend tools: 1. My price dashboard a. The dashboard will allow me to designate for each event category what I think each seat category is worth. An event category is a type of event- for example- all Boston Celtics Regular Season tickets may be an event category i. This means that I should be able to designate that all upper deck seats during the regular season for the Boston Celtics at the Boston Gardens are worth $25, in my opinion. ii. I should not have to enter what I think a seat category is worth more than once for each specific event in an event category b. The dashboard will allow me to designate for specific events (i.e. specific games) the what I think each seat category is worth. This dashboard should take precedence over anything entered into the event category section. i. I should be able to say that a Celtics playoff game at the Boston Garden are worth $50 in my opinion. I should also have the ability to edit specific games values. 2. Add Events Tab a. Allows me to publish a specific event or event category to the site i. I should be able to make a single event or an entire event category live on the site. If putting an event category live (i.e. the entire Boston Celtics season), I should not have to make each individual event live. Homepage: I want the homepage to be fairly simply. I will need some room for text and logos etc which I will write later. It needs to have a search box which should be the focus. I will need the ability to highlight 2-3 events on the homepage. I will do this manually but needs to have a template for me to change the text and event. Additional navigation should include: About, Contact, and Blog. Search Results Page: Date, Teams, Time, Location, Range of prices- in plus or minus my value (lowest and highest), View tickets button Ticket Results Page: The results should be broken up into two categories but all in the same box, the categories should be “X more than my value or less than my value?? and “More than $X over my value?? If no tickets are available in a certain category it should say “No tickets available in this price tier?? Please note that the “$X over my value?? should be changeable for the site so that the $X can be changed by me. Additionally, it should be able to be changed to be a percentage so it could be changed to “X% over my value??. I do not need sliders for price, location, provider, etc. that many of the above mentioned sites have. In the actual listing of the ticket I want: Section, Row, Amount over (or under) value, Price, Quantity, Buy Tickets My affiliate information should be used in all links to Stubhub. It should be automatically sorted for the tickets with the lowest price over/under my value. It should also be sort able by any of the categories- i.e. Section, Row, Amount over my Value, Price, Quantity We should have the venue name, location, and a copy of the seat map on stubhub (you can make it moderate size but if you click it you are taken to stubhub). I also would like google analytics installed on this site. Ideally, every event category would have a unique and easy to spell url (i.e. [login to view URL]) which would be all Boston Celtics games. Obviously, you will have to do graphic design for the site. A rudimentary logo should be included. Bidders on this project need to flexible as every detail is not delineated here. You will have to be willing to work with me as we discover difficulties in this project together. If you think you will blindly code exactly what I list here- you will be mistaken. We will need to be flexible together to get this done. Below is some information from stubhub that may be helpful to you: Stubhubs datafeeds may be helpful- We do have an XML feed that you can access as well as feeds in CSV and Text format that you can access via an FTP server: [login to view URL] The ability to perform a search as in an API or Web Services is not possible, but you can display the particular genres (Sports, Concerts etc.) that you would like by parsing the feeds. The XML feed is located at the below URL and I have also attached the white papers for you to take a look at. Keep in mind that this feed is extremely large (23 MB or so) so I would recommend closing all other programs before trying to access it. [login to view URL] Here is the documentation from Stubhub- StubHub XML Feed Summary The StubHub XML feed is made available to StubHub Network Partners to provide them with the ability to use their own browse interface and provide their users with links to relevant StubHub ticket content. When & Where It is updated hourly and can be found at this URL: [login to view URL] (NOTE: This will most likely crash a normal browser like Internet Explorer) Please note the following: • There are n levels of genres in the genre feed and the table is recursive. • Event data is updated every hour • Max and min ticket price may only update every 24 hours Below are some samples, a relational map, and an explanation of fields. Genre Entry - Tyler Perrys Madea Goes To Jail Tickets Tyler Perrys Madea Goes To Jail Tyler Perrys Madea Goes To Jail 0 177 ,0,174,177,45006 - Tyler Perrys Madea Goes To Jail Tickets - Atlanta Tyler Perrys Madea Goes To Jail Tyler Perrys Madea Goes To Jail 0 45006 ,0,174,177,45006,45012 - Hidden Genre Entry - David Lindley Tickets 0 7167 ,0,1,7167,902 City Entry - - - Tampa Bay 0 404 - - - Florida 403 0 - - /?geography_id=404 Venue Entry - Knology Park 1 404 ,0,403,404,32273 311 Douglas Av Dunedin FL 34698 7277347661 - Event Entry - Chitty Chitty Bang Bang Tickets - New York Chitty Chitty Bang Bang Tickets - New York Chitty, Chitty, Bang, Bang, New York, Hilton 1 236 265 Chitty Chitty Bang Bang Event time subject to change. Please check local listings for exact start time. All sales are final. 2005-04-16T14:00:00 2005-04-14T20:00:00 2004-12-09T18:00:00 43792 8485 9753 Hilton Theater (Formerly Ford Center for the Performing Arts) New York NY Diagram of the date schema that underlies the feed: Field Details: XML Description Data Type Restrictions node id Genre (category) or geography (state, city or venue) ID number number hidden Indicates whether or not the item is hidden. 1 indicates that the item is hidden; 0 indicates that it is not hidden. number 0 or 1 description Name of genre, geography, or event. text title_description Meta title text meta_description Meta description text keywords Meta keywords text ticketsavailable Indicates whether or not tickets are available. 1 indicates that tickets are available; 0 indicate that there are no tickets available. number 0 or 1 parent_id ID number of parent genre or geography - i.e. the node that is one level higher in the hierarchy. number parent_path List of parent IDs, in order of hierarchy. This is the browse path you would take to reach the node. number, comma delimited list min_price Lowest price of available tickets. number max_price Highest price of available tickets. number genre_city geography_id Geography IDs in which there are events in the genre number genre_city_event event_id Event IDs in the genre which are in the geography listed in its genre_city geography_id number event id ID of the event number event_date Date and time of the event, in local time date / time timezone Indicates local time zone of the event; this is the time zone the event's time is listed as text 3 characters last_chance_date Last date and time that the event will be active, in GMT date / time genre_parent The genre to which the event belongs. number geography parent The geography (city, state, venue) of the event. number venue_configuration_id The configuration of the venue for this event. number * * *This broadcast message was sent to all bidders on Wednesday Nov 5, 2008 10:44:20 PM: I just added a PPT document that provides more detail on the site and the control panels I need. I will probably have to explain it to you but it will help insure that we are both on the same page before bids are accepted. thanks