You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The following is a script from the readme with two lines changed, prompt and source in the parameters' list of SmartScraperGraph. I get a timeout and in the documentation, I don't see how to configure the parameter
importjsonfromscrapegraphai.graphsimportSmartScraperGraph# Define the configuration for the scraping pipelinegraph_config= {
"llm": {
"api_key": "YOUR_OPENAI_APIKEY",
"model": "openai/gpt-4o-mini",
},
"verbose": True,
"headless": False,
}
# Create the SmartScraperGraph instancesmart_scraper_graph=SmartScraperGraph(
prompt="Give me the url of all the modules including #",
source="https://scrapegraph-ai.readthedocs.io/en/latest/modules/modules.html",
config=graph_config
)
# Run the pipelineresult=smart_scraper_graph.run()
print(json.dumps(result, indent=4))
The following is a script from the readme with two lines changed,
prompt
andsource
in the parameters' list ofSmartScraperGraph
. I get a timeout and in the documentation, I don't see how to configure the parameterResult
I tried to add timetout in the llm code without much success as follows:
graph_config = { "llm": { "api_key": "YOUR_OPENAI_APIKEY", "model": "openai/gpt-4o-mini", + "timeout": "300", }, "verbose": True, "headless": False, }
The text was updated successfully, but these errors were encountered: