iragent.utility Namespace Reference

Functions
str	fetch_url (str url, str parser="lxml")
List[str]	chunker (str text, int token_limit=512)
list[Agent]	create_agents (list[dict] agents_list, AgentFactory agent_factory)

Function Documentation

chunker()

List[str] iragent.utility.chunker	(	str	text,
		int	token_limit = 512 )

Chunks text into pieces, each not exceeding `token_limit` words (as a rough proxy for tokens).
Sentences are kept intact.

create_agents()

list[Agent] iragent.utility.create_agents	(	list[dict]	agents_list,
		AgentFactory	agent_factory )

fetch_url()

str iragent.utility.fetch_url	(	str	url,
		str	parser = "lxml" )

This uses lxml libary for Parsing the web page.