devtools

Evaluate AI with home-assistant-datasets

Name: Evaluate AI with home-assistant-datasets
Author: allenporter

Get datasets for evaluating AI models in Home Assistant. For founders building smart home integrations.

From the repo · “This package is a collection of datasets for evaluating AI Models in the context of Home Assistant. ”

261 stars+4★ this week21 forksJupyter NotebookGuide quality 8/10 · reviewed Jul 22Updated 10/22/2026100% free · open source

What it does

Home Assistant datasets provides a collection of datasets for evaluating AI models in the context of Home Assistant, allowing founders to test and improve their smart home integrations.

When to use it

•When building a smart home integration that requires machine learning models
•When evaluating the performance of AI models in a Home Assistant environment
•When needing datasets to train and test AI models for home automation tasks

Ready-to-paste prompt

from home_assistant_datasets import load_dataset; dataset = load_dataset('temperature')

Heads up: Make sure to have the necessary dependencies installed, including Jupyter Notebook and the `home-assistant-datasets` package, and be aware that some datasets may require additional setup or preprocessing before use

Saves to your device

Use with Claude

New

Skip the builder — one click puts this in Claude, Cursor, Antigravity and more.

✅ Light setup

Installs with a command or two; your AI agent can do it for you.

Try it instantly — no install

Claude Code

mkdir -p ~/.claude/skills/home-assistant-datasets && curl -fsSL https://workflowstacks.com/api/skills/home-assistant-datasets/claude-skill -o ~/.claude/skills/home-assistant-datasets/SKILL.md

Open in another AI app

Opens the app with this repo with the prompt ready to go — no copy-paste needed.

Connect the whole catalog (MCP)

claude mcp add --transport http workflowstacks https://workflowstacks.com/api/mcp

Adds a WorkflowStacks connector to Claude Code: search and load any skill here by chatting.

How Evaluate AI with home-assistant-datasets works

Codeflow

Free to inspect

Evaluate AI with home-assistant-datasets is a medium Jupyter Notebook project (~5k+ lines across 67 code files). Setup is light: installs like a normal app. Reading the code is optional. Last commit this month, Apache-2.0 license, has a test suite.

Size

Medium codebase

~5k+ lines · 67 code files · 42 min skim · partial scan

Setup

One-command install

Installs like a normal app. Reading the code is optional.

Runs on

Python

No API keys detected

Jupyter Notebook 67%Python 32%Shell 1%

Where to start reading

1
README.md
Start here — what it does and how to install it
2
pyproject.toml
Dependencies and the commands it exposes
3
home_assistant_datasets/__init__.py
Inside home_assistant_datasets/ — the main logic begins here

What's in each folder

home_assistant_datasets/Core code — the actual logic58 files

docs/Documentation1 files

reports/assist/Folder20100 files

reports/assist-mini/Folder8933 files

datasets/Data files7932 files

reports/questions/Folder1119 files

reports/automations/Folder777 files

models/Data models & types74 files

READMEHas testsDocumentedCI checksApache-2.0 licenseUpdated this month

Use with Claude

New

Skip the builder — one click puts this in Claude, Cursor, Antigravity and more.

✅ Light setup

Installs with a command or two; your AI agent can do it for you.

Try it instantly — no install

Claude Code

mkdir -p ~/.claude/skills/home-assistant-datasets && curl -fsSL https://workflowstacks.com/api/skills/home-assistant-datasets/claude-skill -o ~/.claude/skills/home-assistant-datasets/SKILL.md

Open in another AI app

Opens the app with this repo with the prompt ready to go — no copy-paste needed.

Connect the whole catalog (MCP)

claude mcp add --transport http workflowstacks https://workflowstacks.com/api/mcp

Adds a WorkflowStacks connector to Claude Code: search and load any skill here by chatting.

Quick Actions

Details

Creator

allenporter

Language

Jupyter Notebook