TripAdvisor is the world’s biggest travel website and it is a very popular website to find restaurants, hotels, transportation, and spaces to visit. When somebody plans a trip to a city or country, they are expected to visit TripAdvisor to get the finest places for staying and visiting. TripAdvisor has more than 702 million reviews of the world’s top hotels, lists more than 8 million locations (restaurants, hotels, tourist charms), and ranks 1st in the Traveling and Tourism categories in the United States.
In this blog, we will provide a script, which will extract hotel data from the TripAdvisor webpage, scrape a few data elements and make a dataset. Here, are the steps that would be executed using Python & BeautifulSoup.
1. Import different libraries.
2. Review the HTML structure of a web page
3. Retrieve and change HTML Data
4. Find and scrape data elements
5. Make a data frame
6. Convert data frame into a CSV file
# Import the libraries. import requests from bs4 import BeautifulSoup import pandas as pd import csv
Requests permit you to send different HTTP requests to the server, which returns the Response Object having all the reply data (i.e., HTML).
Beautifulsoup (bs4) is used for pulling data out of the HTML files and convert data into a BeautifulSoup object that represents HTML as the nested data structure.
Pandas is used to do data manipulation and analysis.
CSV module implements different classes in reading and writing tabular data within a CSV format.
We have to recognize the contents and structure of HTML tags in webpages. For that project, we would be using TripAdvisor Hawaii Hotels & Places of staying webpage (given below). You can get this webpage through choosing a link.
We can extract this webpage through parsing HTML of a page and scraping the data required for the dataset. To extract some data from the web page, just right-click anywhere on this webpage, choose inspect from a drop-down list and click an arrow icon given on the screen’s upper left-hand side with HTML and click on hotel name (Prince Waikiki) in review section of a webpage. It will result in the given screen shown.
On HTML screen, you would see highlighted an HTML line having the Hotel Name called Prince Waikiki.
If you are moving one line from the tag then you would find a div tag having the class of “listing_title”. It is a parent of tag. Therefore, if you want to find, scrape, and capture hotel names on a webpage you might follow these steps.
Get all HTML lines for any particular parent (div tag having class = listing_title) that might include their related children.
Scrape data elements and create a list having all the hotel names.
The code to find and extract hotel names might be the following:
hotels = []
for name in soup.findAll('div',{'class':'listing_title'}):
hotels.append(name.text.strip())
We will get, scrape and store other data elements on a webpage following similar procedures as given above.
For all data elements we need to scrape, we will get all HTML lines, which are within any particular class and tag. Then, we will scrape data elements as well as store data in the list.
# Find and extract data elements.
hotels = []
for name in soup.findAll('div',{'class':'listing_title'}):
hotels.append(name.text.strip())
ratings = []
for rating in soup.findAll('a',{'class':'ui_bubble_rating'}):
ratings.append(rating['alt'])
reviews = []
for review in soup.findAll('a',{'class':'review_count'}):
reviews.append(review.text.strip())
prices = []
for p in soup.findAll('div',{'class':'price-wrap'}):
prices.append(p.text.replace('₹','').strip())
We would create a dictionary, which will have data names and standards for all data elements which were scraped.
# Create the dictionary.
dict = {'Hotel Names':hotels,'Ratings':ratings,'Number of Reviews':reviews,'Prices':prices}
Create and show a data frame.
# Create the dataframe. hawaii = pd.DataFrame.from_dict(dict) hawaii.head(10)
# Convert dataframe to CSV file.
hawaii.to_csv('hotels.csv', index=False, header=True)
Making it all together…
# Import the libraries.
import requests
from bs4 import BeautifulSoup
import pandas as pd
import csv
# Extract the HTML and create a BeautifulSoup object.
url = ('https://www.tripadvisor.in/Hotels-g28932-Hawaii-Hotels.html')
user_agent = ({'User-Agent':
'Mozilla/5.0 (Windows NT 10.0; Win64; x64) \
AppleWebKit/537.36 (KHTML, like Gecko) \
Chrome/90.0.4430.212 Safari/537.36',
'Accept-Language': 'en-US, en;q=0.5'})
def get_page_contents(url):
page = requests.get(url, headers = user_agent)
return BeautifulSoup(page.text, 'html.parser')
soup = get_page_contents(url)
# Find and extract the data elements.
hotels = []
for name in soup.findAll('div',{'class':'listing_title'}):
hotels.append(name.text.strip())
ratings = []
for rating in soup.findAll('a',{'class':'ui_bubble_rating'}):
ratings.append(rating['alt'])
reviews = []
for review in soup.findAll('a',{'class':'review_count'}):
reviews.append(review.text.strip())
prices = []
for p in soup.findAll('div',{'class':'price-wrap'}):
prices.append(p.text.replace('₹','').strip())
# Create the dictionary.
dict = {'Hotel Names':hotels,'Ratings':ratings,'Number of Reviews':reviews,'Prices':prices}
# Create the dataframe.
hawaii = pd.DataFrame.from_dict(dict)
hawaii.head(10)
# Convert dataframe to CSV file.
hawaii.to_csv('hotels.csv', index=False, header=True)
Thank you so much to read this blog. Please give your valuable comments or feedback. For the best mobile app scraping and web scraping services, contact Actowiz Solutions now!
✨ "1000+ Projects Delivered Globally"
⭐ "Rated 4.9/5 on Google & G2"
🔒 "Your data is secure with us. NDA available."
💬 "Average Response Time: Under 12 hours"
Look Back Analyze historical data to discover patterns, anomalies, and shifts in customer behavior.
Find Insights Use AI to connect data points and uncover market changes. Meanwhile.
Move Forward Predict demand, price shifts, and future opportunities across geographies.
Industry:
Coffee / Beverage / D2C
Result
2x Faster
Smarter product targeting
Operations Manager, Beanly Coffee
✓ Competitive insights from multiple platforms
Industry:
Real Estate
Result
2x Faster
Real-time RERA insights for 20+ states
Data Analyst, Aditya Birla Group
✓ Boosted data acquisition speed by 3×
Industry:
Organic Grocery / FMCG
Result
Improved
competitive benchmarking
Product Manager, 24Mantra Organic
✓ Real-time SKU-level tracking
Industry:
Quick Commerce
Result
2x Faster
Inventory Decisions
Aarav Shah, Senior Data Analyst, Mensa Brands
✓ 28% product availability accuracy
✓ Reduced OOS by 34% in 3 weeks
Industry:
Quick Commerce
Result
3x Faster
improvement in operational efficiency
Business Development Lead,Organic Tattva
✓ Weekly competitor pricing feeds
Industry:
Beverage / D2C
Result
Faster
Trend Detection
Marketing Director, Sleepyowl Coffee
Boosted marketing responsiveness
Industry:
Quick Commerce
Result
Enhanced
stock tracking across SKUs
Growth Analyst, TheBakersDozen.in
✓ Improved rank visibility of top products
Real results from real businesses using Actowiz Solutions
In Stock
₹524
Price Drop + 12 min
in 6 hrs across Lel.6
Price
Drop −12 thr
Improved inventory
visibility & planning
Actowiz's real-time scraping dashboard helps you monitor stock levels, delivery times, and price drops across Blinkit, Amazon: Zepto & more.
✔ Scraped Data: Price Insights Top-selling SKUs
"Actowiz's helped us reduce out of stock incidents by 23% within 6 weeks"
✔ Scraped Data, SKU availability, delivery time
With hourly price monitoring, we aligned promotions with competitors, drove 17%
✔ Scraped Data, SKU availability, delivery time
"Actowiz's helped us reduce out of stock incidents by 23% within 6 weeks"
✔ Scraped Data, SKU availability, delivery time
Actionable Blogs, Real Case Studies, and Visual Data Stories -All in One Place
Unlock OTA growth with Scraping Booking.com Data for Competitive Pricing Analysis. Gain real-time insights, optimize pricing, and stay ahead of competitors.
how resorts Scrape Booking.com Seasonal Pricing Trends for Resorts to optimize peak season campaigns, maximize bookings, and drive revenue.
reveals how brands Extract Festive Sale Data from Amazon, Flipkart & Reliance with 90% flash-sale alerts and 50+ brands analyzed.
Unlock OTA growth with Scraping Booking.com Data for Competitive Pricing Analysis. Gain real-time insights, optimize pricing, and stay ahead of competitors.
Unlock Sephora’s stock insights with Sephora Inventory & Stock Data Scraping API, tracking product availability across regions with 90–98% accuracy.
Discover weekly fee variations with Web Scraping weekly Delivery Fees Data From GrabFood, revealing PH, SG, and MY delivery costs shifting 10–25%.
how resorts Scrape Booking.com Seasonal Pricing Trends for Resorts to optimize peak season campaigns, maximize bookings, and drive revenue.
Real-Time Price Monitoring for Luxury Brands, highlighting Louis Vuitton, Gucci, and Prada across global markets with key pricing insights.
Learn how Actowiz Solutions helped Indian retailers meet festive demand for sweets & snacks using real-time grocery data, scraping & analytics.
reveals how brands Extract Festive Sale Data from Amazon, Flipkart & Reliance with 90% flash-sale alerts and 50+ brands analyzed.
Explore Historical Navratri Sales Data from 2020–2025 to track discounts, flash sales, and consumer trends across Amazon, Flipkart, and Myntra.
Explore Myntra vs Ajio Navratri discount scraping insights for 2025—compare festive fashion offers, flash sales, and 2x shopper growth trends.
