-
Notifications
You must be signed in to change notification settings - Fork 1.4k
Description
Documenting the selenium-wire "Wire Mode" REPLACEMENT.
As many of you know, there's a selenium-wire integration via SeleniumBase Wire Mode.
There are two main issues with it:
- Wire Mode isn't compatible with UC Mode.
- selenium-wire has been archived. (No more updates)
Here's the good news: selenium-wire features are included in the new SeleniumBase CDP Mode, (a subset of UC Mode).
Here's an example of that, (SeleniumBase/examples/cdp_mode/raw_res_sb.py), where network requests and responses are captured and displayed:
"""Using CDP.network.ResponseReceived and CDP.network.RequestWillBeSent.""" import colorama import mycdp import sys from seleniumbase import SB c1 = colorama.Fore.BLUE + colorama.Back.LIGHTYELLOW_EX c2 = colorama.Fore.BLUE + colorama.Back.LIGHTGREEN_EX cr = colorama.Style.RESET_ALL if "linux" in sys.platform: c1 = c2 = cr = "" async def send_handler(event: mycdp.network.RequestWillBeSent): r = event.request s = f"{r.method} {r.url}" for k, v in r.headers.items(): s += f"\n\t{k} : {v}" print(c1 + "*** ==> RequestWillBeSent <== ***" + cr) print(s) async def receive_handler(event: mycdp.network.ResponseReceived): print(c2 + "*** ==> ResponseReceived <== ***" + cr) print(event.response) with SB(uc=True, test=True, locale_code="en") as sb: sb.activate_cdp_mode("about:blank") sb.cdp.add_handler(mycdp.network.RequestWillBeSent, send_handler) sb.cdp.add_handler(mycdp.network.ResponseReceived, receive_handler) url = "https://seleniumbase.io/apps/calculator" sb.cdp.open(url) sb.sleep(1)
Usage is different from regular Selenium-Wire, but it can do all the same things (and more) with better flexibility/control.
Here's another example, (SeleniumBase/examples/cdp_mode/raw_req_sb.py), where specific requests were filtered out (intercepted and blocked), to prevent images from loading:
"""Using CDP.fetch.RequestPaused to filter content in real-time.""" import colorama import mycdp import sys from seleniumbase import SB c1 = colorama.Fore.RED + colorama.Back.LIGHTYELLOW_EX c2 = colorama.Fore.BLUE + colorama.Back.LIGHTCYAN_EX cr = colorama.Style.RESET_ALL if "linux" in sys.platform: c1 = c2 = cr = "" async def request_paused_handler(event, tab): r = event.request is_image = ".png" in r.url or ".jpg" in r.url or ".gif" in r.url if not is_image: # Let the data through tab.feed_cdp(mycdp.fetch.continue_request(request_id=event.request_id)) else: # Block the data (images) TIMED_OUT = mycdp.network.ErrorReason.TIMED_OUT s = f"{c1}BLOCKING{cr} | {c2}{r.method}{cr} | {r.url}" print(f" >>> ------------\n{s}") tab.feed_cdp(mycdp.fetch.fail_request(event.request_id, TIMED_OUT)) with SB(uc=True, test=True, locale_code="en") as sb: sb.activate_cdp_mode("about:blank") sb.cdp.add_handler(mycdp.fetch.RequestPaused, request_paused_handler) url = "https://gettyimages.com/photos/firefly-2003-nathan" sb.cdp.open(url) sb.sleep(5)
If people don't need the stealth features (or other improvements made to intercepting/handling network requests & responses), then they can continue using the existing Wire Mode as is. Or, if people want the upgrades, then they can use the new CDP Mode, (as shown above).