Assignment

1️⃣ HTTP Requests with `requests` (5 Assignments)

Assignment 1: Install `requests` and Fetch a Web Page

🔹 Task: Install requests and make a simple GET request. 🔹 Example Command:

pip install requests

🔹 Example Snippet:

import requests

response = requests.get("https://www.example.com")
print(response.text)

Assignment 2: Check Response Status Code

🔹 Task: Fetch a URL and print its status code. 🔹 Example Snippet:

response = requests.get("https://www.example.com")
print(f"Status Code: {response.status_code}")

Assignment 3: Send a POST Request with Data

🔹 Task: Make a POST request with form data. 🔹 Example Snippet:

data = {"username": "user", "password": "pass"}
response = requests.post("https://httpbin.org/post", data=data)
print(response.json())

Assignment 4: Handle HTTP Headers in a Request

🔹 Task: Send a request with custom headers. 🔹 Example Snippet:

headers = {"User-Agent": "Mozilla/5.0"}
response = requests.get("https://www.example.com", headers=headers)
print(response.text)

Assignment 5: Handle API Responses (JSON Format)

🔹 Task: Fetch and parse JSON data from an API. 🔹 Example Snippet:

response = requests.get("https://jsonplaceholder.typicode.com/posts/1")
data = response.json()
print(data["title"])

2️⃣ Parsing HTML with BeautifulSoup (5 Assignments)

Assignment 6: Install BeautifulSoup and Parse an HTML Page

🔹 Task: Install beautifulsoup4 and parse a simple HTML page. 🔹 Example Command:

pip install beautifulsoup4

🔹 Example Snippet:

from bs4 import BeautifulSoup

html = "<html><head><title>Test</title></head><body>Hello!</body></html>"
soup = BeautifulSoup(html, "html.parser")
print(soup.title.text)

Assignment 7: Extract All Links from a Web Page

🔹 Task: Fetch and extract all anchor (<a>) tags. 🔹 Example Snippet:

from bs4 import BeautifulSoup
import requests

response = requests.get("https://www.example.com")
soup = BeautifulSoup(response.text, "html.parser")

for link in soup.find_all("a"):
    print(link.get("href"))

Assignment 8: Extract Text from Specific HTML Elements

🔹 Task: Extract all paragraph (<p>) texts from a page. 🔹 Example Snippet:

soup = BeautifulSoup(response.text, "html.parser")
paragraphs = soup.find_all("p")

for p in paragraphs:
    print(p.text)

Assignment 9: Extract Data from Tables

🔹 Task: Scrape table data from an HTML page. 🔹 Example Snippet:

table = soup.find("table")
for row in table.find_all("tr"):
    columns = row.find_all("td")
    print([col.text for col in columns])

Assignment 10: Extract Images from a Web Page

🔹 Task: Find all image (<img>) sources. 🔹 Example Snippet:

for img in soup.find_all("img"):
    print(img.get("src"))

3️⃣ Extracting Data from Web Pages (5 Assignments)

Assignment 11: Web Scraping with Pagination

🔹 Task: Scrape data from multiple pages. 🔹 Example Snippet:

for page in range(1, 4):
    url = f"https://example.com/page/{page}"
    response = requests.get(url)
    print(f"Page {page} content length: {len(response.text)}")

Assignment 12: Scrape Job Listings from a Website

🔹 Task: Extract job titles from a job portal. 🔹 Example Snippet:

jobs = soup.find_all("div", class_="job-title")
for job in jobs:
    print(job.text.strip())

Assignment 13: Extract Product Prices from an E-commerce Site

🔹 Task: Fetch product names and prices. 🔹 Example Snippet:

products = soup.find_all("div", class_="product")
for product in products:
    name = product.find("h2").text
    price = product.find("span", class_="price").text
    print(f"{name}: {price}")

Assignment 14: Download Images from a Website

🔹 Task: Download and save images. 🔹 Example Snippet:

import os

img_url = "https://example.com/image.jpg"
img_data = requests.get(img_url).content

with open("image.jpg", "wb") as f:
    f.write(img_data)

Assignment 15: Scrape Weather Data from a Website

🔹 Task: Extract temperature from a weather site. 🔹 Example Snippet:

temperature = soup.find("span", class_="temp").text
print(f"Current Temperature: {temperature}")

4️⃣ Regex (`re` Module) for Pattern Matching (5 Assignments)

Assignment 16: Validate Email Addresses with Regex

🔹 Task: Check if an email is valid. 🔹 Example Snippet:

import re

email = "test@example.com"
pattern = r"^[a-zA-Z0-9_.+-]+@[a-zA-Z0-9-]+\.[a-zA-Z0-9-.]+$"

if re.match(pattern, email):
    print("Valid Email")
else:
    print("Invalid Email")

Assignment 17: Extract All URLs from Text

🔹 Task: Find all links in a text. 🔹 Example Snippet:

text = "Visit https://example.com and http://test.com"
pattern = r"https?://[^\s]+"

urls = re.findall(pattern, text)
print(urls)

Assignment 18: Find Phone Numbers in a Text

🔹 Task: Extract phone numbers using regex. 🔹 Example Snippet:

text = "Call me at 9876543210 or 123-456-7890"
pattern = r"\b\d{10}\b|\b\d{3}-\d{3}-\d{4}\b"

phones = re.findall(pattern, text)
print(phones)

Assignment 19: Extract Dates from a Text

🔹 Task: Find all dates in a text. 🔹 Example Snippet:

text = "Today's date is 12/08/2024 and yesterday was 11-08-2024"
pattern = r"\b\d{2}[-/]\d{2}[-/]\d{4}\b"

dates = re.findall(pattern, text)
print(dates)

Assignment 20: Remove HTML Tags from Text

🔹 Task: Use regex to strip HTML tags. 🔹 Example Snippet:

html = "<p>Hello <b>World</b></p>"
clean_text = re.sub(r"<.*?>", "", html)
print(clean_text)

PreviousWeek 9 Nextweek 10

Last updated 9 months ago