OpenOwl is a set of tools for monitoring open-source project communities. While other tools monitor deterministic security metrics (see scorecard.dev, oss-fuzz, deps.dev, or osv.dev), OpenOwl focusses on the unstructured communication and community health aspects of open-source projects.
- Monitoring for toxicity and other metrics: We monitor open-source dependencies by analyzing communication patterns in issues and pull requests. Rather than judging project culture directly, it tracks changes in toxicity levels and other metrics such as length of comment chains, or number of downvotes over time. These metrics serve as early warning signs for community issues, which often lead to increased bugs and vulnerabilities.
Work in progress screenshot of the web app:
Prerequisites:
- Python 3.12
- Poetry
- Copy
.env.exampleto.envand fill in the variables - Access to LLM API (currently supported: Anthropic (Claude), TBD: Ollama, OpenAI)
Install dependencies
poetry installStart fast-api server
poetry run uvicorn openowl.api:app --reloadRun Streamlit dashboard
poetry run streamlit run openowl/app.py The dashboard should now be available at http://localhost:8501.
If you prefer to use docker for development, you can use the provided docker-compose.yml file.
Prerequisites:
- Docker
- Docker Compose
- Copy
.env.exampleto.envand fill in the variables - Access to LLM API (currently supported: Anthropic (Claude), TBD: Ollama, OpenAI)
Start the docker-based setup with the following command:
docker-compose up --build{
"dependencies": {
"<dependency_id>": {
"package_manager": "<string>", // e.g. "pypi"
"owner": "<string>", // e.g. "pandas-dev"
"name": "<string>", // e.g. "pandas"
"version": "<string>", // e.g. "2.2.3"
"id": "<string>" // hash identifier
}
},
"issues": {
"<issue_number>": {
"html_url": "<string>",
"id": "<number>",
"number": "<number>",
"title": "<string>",
"created_at": "<datetime>",
"updated_at": "<datetime>",
"closed_at": "<datetime|null>",
"body": "<string>",
"author_association": "<string>",
"comments": "<number>",
"state": "<string>", // e.g. "open", "closed"
"user": {
"login": "<string>",
"id": "<number>",
"site_admin": "<boolean>"
},
"reactions": {
"url": "<string>",
"total_count": "<number>",
"+1": "<number>",
"-1": "<number>",
"laugh": "<number>",
"hooray": "<number>",
"confused": "<number>",
"heart": "<number>",
"rocket": "<number>",
"eyes": "<number>"
},
"assignees": [],
"comments_list": [
{
"url": "<string>",
"id": "<number>",
"created_at": "<datetime>",
"updated_at": "<datetime>",
"author_association": "<string>",
"body": "<string>",
"reactions": {
// same structure as issue reactions
},
"performed_via_github_app": "<any|null>",
"user": {
// same structure as issue user
}
}
]
}
},
"issue_dependency": {
"<mapping_id>": {
"issue_id": "<number>",
"dependency_id": "<string>" // references dependencies[x].id
}
}
}