Local AI Automation Platform

Project title: Build a Secure Local AI Assistant for Autonomous Business and Desktop Operations

Project objective

Build a self-contained AI assistant that runs on one dedicated, always-on PC in my office. I give it instructions in plain English, and it plans, executes, checks and reports the work.

The assistant must support multiple businesses and a broad range of computer-based tasks. Inventory, invoicing and scheduling are examples of possible uses; they are not the limits of this project.

I select and purchase the hardware.
My planned machine costs approximately $10,000–$15,000 and includes multiple GPUs and storage drives. Your responsibility is the software platform, installation, configuration, integration, testing and handover. Confirm compatibility against the specifications I provide.

1. Local operation and ownership
- Run the AI models, speech processing, business knowledge, task history, databases and automation services locally.
- The core platform must operate without cloud AI inference or paid AI subscriptions.
- Internet access remains available for tasks involving websites, customer communications, online accounts and payment services. Local operation refers to where the intelligence and data processing run.
- Any optional escalation to an external AI provider must be separately configurable, disabled by default and subject to my data-sharing and spending rules.
- I own and receive the source code, configuration, business data and documentation. The system must remain usable without the developer’s servers or ongoing involvement.

2. Plain-English task execution

I must be able to specify an outcome without describing every click or requiring a developer to code each task.

The assistant must:

- Break requests into steps and identify the information and access required.
- Use browsers, desktop applications, local files and APIs.
- Execute immediate, scheduled, recurring and event-triggered tasks.
- Run multiple tasks while preserving each task’s instructions, progress and business context.
- Ask targeted questions when essential information is missing.
- Verify the actual outcome before reporting completion.
- Recover from interruptions and resume unfinished work after a restart.

3. Business operations

Within the accounts and authority I configure, the assistant must support activities such as:

- Registering accounts and completing website forms.
- Reading and answering customer enquiries.
- Preparing and sending invoices, tracking payments and managing routine records.
- Processing permitted payment transactions through established payment services.
- Managing stock, orders, appointments and reminders.
- Producing documents, reports and exports.
- Performing repetitive administrative work across websites and desktop applications.

Identify dependencies such as MFA, CAPTCHA, identity verification, service restrictions and unavailable integrations. Explain how the platform handles them without losing task progress.

4. Learn workflows from demonstrations

A central requirement is learning new procedures without commissioning a separate custom application every time.

For example, I should be able to instruct:

“Observe this authorised desktop while claims are processed, identify the procedure and create an automation that performs the same work.”

The system must capture relevant screen activity and application interactions, combine these with documents and explanations, identify decision points, and create reusable workflows.

It must support targeted clarification, test runs, correction, versioning and handling of exceptions. Describe which workflows it can learn independently and which require developer integration.

**5. Meeting and live assistance

Provide local transcription and assistance from authorised microphone or system-audio sources, including suitable hardware audio inputs.

Example instructions:

- “Listen to this meeting and produce an action list with owners and deadlines.”
- “Use my approved documents to suggest an answer on screen when I receive a question.”

This must include live transcription, action extraction and an on-screen assistance panel. Explain how audio sources and speakers are identified and how transcripts are stored locally.

**6. Reliable memory and separation**

The assistant must keep businesses, accounts and tasks separate. It must not mix instructions, customer records, credentials or financial information between businesses.

Provide:

- Separate business workspaces and access controls.
- Persistent instructions, task state and source-linked knowledge.
- Clear distinction between confirmed facts, assumptions and unresolved questions.
- A way to inspect, correct and remove stored knowledge.
- Protection against instructions embedded in websites, emails or documents overriding my operating rules.

Do not rely on one continuously growing chat history as the system’s memory architecture.

**7. Security and operational controls**

Include encrypted credential storage, restricted developer access, configurable account permissions, transaction limits, audit logs, backups and a tested restore process.

Routine tasks within my configured authority should execute automatically. Actions outside that authority must pause with a clear explanation.

Provide an emergency stop, visibility into running tasks, and controls to pause or cancel individual workflows.

**8. User interface**

Provide a straightforward local dashboard where I can:

- Give written or spoken instructions.
- Select the relevant business and accounts.
- View running tasks, results and exceptions.
- Manage workflows, schedules, permissions and memory.
- Inspect logs and supporting evidence.
- Manage local models and monitor hardware usage.

**9. Delivery and acceptance**

Quote against milestones:

1. Software architecture and compatibility review using my supplied hardware specifications.
2. Installation of the working local platform.
3. Demonstration of a browser workflow, a desktop workflow learned from demonstrations, and local meeting assistance.
4. Reliability testing, security configuration, documentation and handover.

Acceptance requires demonstration that:

- Core AI processing operates with external AI services disconnected.
- The assistant completes agreed workflows on fresh test cases.
- Business contexts and credentials remain separate.
- Interrupted tasks resume without duplicating completed transactions.
- Failed or unverified actions are reported accurately.
- Backup and restoration work.
- I can introduce a new supported workflow through instructions, documents and demonstrations without modifying source code.

Agree measurable success rates, response times and test cases before implementation. Do not substitute a model’s claimed confidence percentage for tested reliability.

**What your proposal must contain**

Provide the proposed architecture, local models, supported operating system, integration approach, relevant completed projects, milestone prices, timeline, licence costs, maintenance requirements and limitations.

Clearly separate capabilities demonstrated today from capabilities requiring custom development or research.

**The intended result is a reusable local AI operator that performs directed work across multiple businesses—not a chatbot with a few fixed automations.**