51,728 questions
- Bountied 0
- Unanswered
- Frequent
- Score
- Trending
- Week
- Month
- Unanswered (my tags)
4
votes
2
answers
83
views
How to fix "requests.exceptions.ConnectionError" when using requests library python?
I have been trying to make a scraper that downloads comics from Poorly Drawn Lines but I keep on getting a requests.exceptions.ConnectionError: ('Connection aborted.', RemoteDisconnected('Remote end ...
1
vote
2
answers
181
views
Can't access <tr> in <table> with VBA
I'm using VBA to import the table from Federal Fund Rates into Excel.
So far I've got:
Set HTMLDoc = CreateObject("HTMLFILE")
HTMLDoc.body.innerHTML = objHTTP.responseText�
������������������...
Best practices
1
vote
5
replies
218
views
Scrape table from Web to Excel
I need to import the currency exchange rate table to Excel from the web (here's the link to the website https://vrbank.com.vn/ru/exchange-rate/) and update it on a daily basis. I've tried to use Power ...
-4
votes
1
answer
87
views
Getting an error code on my web scraping assignment
I am new to coding and am doing a scraping problem a friend sent me. I have set up this Scraping code according to the assignment but am getting the error code 403, but it's not telling me what's ...
1
vote
1
answer
52
views
selectolax: how to get text of an element?
I have
from selectolax.lexbor import LexborHTMLParser
html = """
<a rel="mw:WikiLink" href="Reconstruction" title="Proto-Germanic">
<span ...
2
votes
1
answer
64
views
Varying anchors when scraping markup
I'm building a web crawler and need to parse anchor tags to extract URLs. However, I'm running into issues identifying whether an href attribute contains a full URL path or a relative/internal path.
...
Advice
0
votes
4
replies
166
views
Instagram API WANTED
I am trying to find a public or unofficial Instagram API to build a downloader. There are many services that can already fetch videos, photos, Stories and Reels, so the needed endpoints clearly exist. ...
2
votes
2
answers
100
views
BeautifulSoup - Extracting content blocks after specific subheadings within a larger section, ignoring document introduction
I am scraping the Dead by Daylight Fandom wiki (specifically TOME pages, e.g., https://deadbydaylight.fandom.com/wiki/Tome_1_-_Awakening) to extract memory logs.
The goal is to extract the Memory ...
3
votes
1
answer
69
views
Nodriver does not take exception if element not found?
I am trying to search for elements on a webpage and have used various methods, including text and XPath. It seems that the timeout option does not work the way I expected, and no exception is raised ...
0
votes
2
answers
219
views
Beautiful Soup, children are clearly inside but can't get it
From the below structure I only want value of href attribute. But rec_block is returning h5 element without its children so basically <h5 class="series">Recommendations</h5>.
<...
3
votes
1
answer
159
views
How to stop/kill achieved Scrapy spider instance within RStudio
I'm making a tutorial on how to scrape with Scrapy. For that, I use Quarto/RStudio and the website https://quotes.toscrape.com/. For pedagogic purposes, I need to run a first crawl on the first page, ...
Advice
0
votes
5
replies
84
views
How to fetch a realTime news Data feed
I wanted to know how I can get live news feed data (INDIAN), without any or like minimal latency (30-40 seconds). I tried using some RSS feeds, but all they do is provide the data as some latency, so ...
0
votes
0
answers
71
views
Camoufox browser window remains visible in WSL even when `headless` is set to `virtual`
Camoufox browser window remains visible in WSL even when headless is set to virtual
Description
When headless is set to "virtual", the Camoufox browser window still appears on the screen in ...
1
vote
0
answers
93
views
Invoke-WebRequest URL encoding
I want to retrieve content from web page. However, I tried above method but the error still come when the query string contain Chinese character.
code
$json = Get-Content -Encoding utf8 -Path "./...
-4
votes
2
answers
77
views
How can I get BBFC ratings in python? [closed]
I am trying to write code to give me BBFC film ratings. I am using selenium to do this but would be happy with any solution that works reliably. After a lot of work I finally came up with this code:
#...