Boats & Yachts Data And API Creation [Web Scraping]
Scrape all listings boats & yachts data and pics for each advertisement continually along with url. Check every 24 hour period for any changes or updates to any of the ads.
At each scrape every 24 hours.
Check for any difference in listing text
Check for chasing it status( sold, sale pending etc..)
Change in price Find duplicates
Change in broker name
Change in location
After scraping…group each listing into “same” so we can do calculations.
- Avg days on market for each yacht
- # of boats currently on market total
- # of boats of each “ same” boat currently in market
- # of boats all year or within 6 months
- Avg listing price for each boat
- Avg selling price ( using data from boat wizard)
- Avg engine hours $ amount above or below
- Avg market price if low price and low
- # days sold ( combos of these scenarios)
- # of people viewing each listing # of offers presented
- # of people who favorited Open listing or exclusive
- Engine hours
- Common options
- Engine warranty
- Motivation ( the word motivated)
- Engine sizes
- Common engines for each make/model
Create restful API where front end developers.