fix a small selenium problem at lowest budget

Job ID: 36089926

Budget: $2 – $4 USD

Getting Reservation ID: 19340497... DONE
Getting Reservation ID: 18517192... DONE
Getting Reservation ID: 19210371... DONE
Getting Reservation ID: 19209522... DONE
Getting Reservation ID: 19227244... DONE
Getting Reservation ID: 18517192... DONE
Getting Reservation ID: 19340497... DONE
Getting Reservation ID: 19037803... DONE
Getting Reservation ID: 19504831... DONE
1%|▌ | 9/612 [01:38<1:49:44, 10.92s/it]
103.115.199.144 - - [28/Feb/2023 04:24:56] "POST /process_year HTTP/1.1" 500 -
Traceback (most recent call last):
File "/usr/local/lib/python3.10/dist-packages/flask/app.py", line 2551, in __call__
return self.wsgi_app(environ, start_response)
File "/usr/local/lib/python3.10/dist-packages/flask/app.py", line 2531, in wsgi_app
response = self.handle_exception(e)
File "/usr/local/lib/python3.10/dist-packages/flask_cors/extension.py", line 165, in wrapped_function
return cors_after_request(app.make_response(f(*args, **kwargs)))
File "/usr/local/lib/python3.10/dist-packages/flask/app.py", line 2528, in wsgi_app
response = self.full_dispatch_request()
File "/usr/local/lib/python3.10/dist-packages/flask/app.py", line 1825, in full_dispatch_request
rv = self.handle_user_exception(e)
File "/usr/local/lib/python3.10/dist-packages/flask_cors/extension.py", line 165, in wrapped_function
return cors_after_request(app.make_response(f(*args, **kwargs)))
File "/usr/local/lib/python3.10/dist-packages/flask/app.py", line 1823, in full_dispatch_request
rv = self.dispatch_request()
File "/usr/local/lib/python3.10/dist-packages/flask/app.py", line 1799, in dispatch_request
return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args)
File "/usr/local/lib/python3.10/dist-packages/flask_cors/decorator.py", line 128, in wrapped_function
resp = make_response(f(*args, **kwargs))
File "/home/ubuntu/server.py", line 543, in process_year
df = extract_trip_data(urls)
File "/home/ubuntu/server.py", line 411, in extract_trip_data
driver.get(url)
File "/usr/local/lib/python3.10/dist-packages/undetected_chromedriver/__init__.py", line 609, in get_wrapped
return orig_get(*args, **kwargs)
File "/usr/local/lib/python3.10/dist-packages/undetected_chromedriver/__init__.py", line 645, in get
return super().get(url)
File "/usr/local/lib/python3.10/dist-packages/selenium/webdriver/remote/webdriver.py", line 449, in get
self.execute(Command.GET, {"url": url})
File "/usr/local/lib/python3.10/dist-packages/selenium/webdriver/remote/webdriver.py", line 440, in execute
self.error_handler.check_response(response)
File "/usr/local/lib/python3.10/dist-packages/selenium/webdriver/remote/errorhandler.py", line 245, in check_response
raise exception_class(message, screen, stacktrace)
selenium.common.exceptions.WebDriverException: Message: unknown error: session deleted because of page crash
from unknown error: cannot determine loading status
from tab crashed
(Session info: chrome=111.0.5563.41)
Stacktrace:
#0 0x5569cd3fbd93 <unknown>
#1 0x5569cd1ca15d <unknown>
#2 0x5569cd1b608c <unknown>
#3 0x5569cd1b5531 <unknown>
#4 0x5569cd1b45bb <unknown>
#5 0x5569cd1b4404 <unknown>
#6 0x5569cd1b2ee2 <unknown>
#7 0x5569cd1b3682 <unknown>
#8 0x5569cd1c0b4f <unknown>
#9 0x5569cd1c17a2 <unknown>
#10 0x5569cd1d1ba0 <unknown>
#11 0x5569cd1d5e40 <unknown>
#12 0x5569cd1b3b43 <unknown>
#13 0x5569cd1d17dc <unknown>
#14 0x5569cd24283a <unknown>
#15 0x5569cd22a353 <unknown>
#16 0x5569cd1f9e40 <unknown>
#17 0x5569cd1fb038 <unknown>
#18 0x5569cd44f8be <unknown>
#19 0x5569cd4538f0 <unknown>
#20 0x5569cd433f90 <unknown>
#21 0x5569cd454b7d <unknown>
#22 0x5569cd425578 <unknown>
#23 0x5569cd479348 <unknown>
#24 0x5569cd4794d6 <unknown>
#25 0x5569cd493341 <unknown>
#26 0x7fc8e1082609 start_thread

check why this is happening
Related categories: Python Flask Selenium