ai-agent

koalas

Koalas: pandas API on Apache Spark
3,371 stars369 forksPythonUpdated 3/20/2024100% free · open source
What it does

Koalas allows you to use the familiar pandas API to manipulate and analyze large-scale data on Apache Spark, enabling scalable data processing with a Pythonic interface.

When to use it
  • •When working with big data that exceeds the memory limits of a single machine
  • •When needing to perform data analysis and machine learning tasks on distributed data
  • •When already familiar with pandas and wanting to leverage its API for large-scale data processing
Ready-to-paste prompt
ks.from_pandas(pd.DataFrame({'A': [1, 2, 3], 'B': [4, 5, 6]})).groupby('A').sum().to_pandas()
Heads up: Koalas requires Apache Spark to be installed and configured properly, and the Spark version must be compatible with the Koalas version, as specified in the Koalas README
Saves to your device
Use with Claude
New

Skip the builder — one click puts this in Claude, Cursor, Antigravity and more.

✅ Light setup

Installs with a command or two; your AI agent can do it for you.

Try it instantly — no install
Claude Code
mkdir -p ~/.claude/skills/koalas && curl -fsSL https://workflowstacks.com/api/skills/koalas/claude-skill -o ~/.claude/skills/koalas/SKILL.md
Open in another AI app

Opens the app with this repo with the prompt ready to go — no copy-paste needed.

Connect the whole catalog (MCP)
claude mcp add --transport http workflowstacks https://workflowstacks.com/api/mcp

Adds a WorkflowStacks connector to Claude Code: search and load any skill here by chatting.

How koalas works
Codeflow
Free to inspect

Koalas is a large Python project (~36k lines across 57 code files, plus 46 test files). Setup is light: installs like a normal app. Reading the code is optional. Last commit 31 months ago, Apache-2.0 license, has a test suite.

Size
Large codebase
~36k lines · 57 code files · ~5 h to skim
Setup
One-command install
Installs like a normal app. Reading the code is optional.
Runs on
Python
No API keys detected
Python 99%Shell 1%
Where to start reading
  1. 1
    README.md
    Start here — what it does and how to install it
What's in each folder
docs/Documentation33 files
databricks/Folder97 files
dev/Folder9 files
icons/Images & static assets4 files
.github/CI / automation (GitHub Actions)1 files
READMEHas testsDocumentedCI checksApache-2.0 licenseLast update 31 mo ago
Quick Actions
Details
Creator
databricks
Language
Python
Category
ai-agent
Published
1/3/2019

Are you the creator of this tool? and earn 85% of every sale.

Show it off in your README:

Featured on WorkflowStacks
[![Featured on WorkflowStacks](https://workflowstacks.com/api/badge/koalas.svg)](https://workflowstacks.com/skills/koalas?utm_source=github&utm_medium=badge)
🔥 Hot this week, in your inbox
Skills like this, every Monday.

The five fastest-growing open-source AI skills, ranked by GitHub star growth. One email a week, unsubscribe anytime.