The Sidecar technology will allow you to significantly expand the capabilities of your AI Apps. With this feature, you can ask AI to add the tools your app needs for specific tasks.
For example, your app can:
- convert and extract data from documents
- open and interact with websites
- read scanned PDFs and images
- search across files and content
- process audio and video
Common use cases #
Browser automation #
Use this when your app needs to open websites, click through flows, take screenshots, or collect data from dynamic pages.
OCR and document reading #
Use this when your app needs to read scanned PDFs, receipts, invoices, forms, or screenshots.
Media processing #
Use this when your app needs to convert, trim, extract, or transform audio and video files.
File conversion #
Use this when your app needs to turn files into other formats or normalize uploads before processing.
AI tasks #
Use this when your app needs to summarize, classify, extract structured data, or answer questions.
How to use it #
You can also add the necessary functionality to your app using standard prompts. Describe what you want your app to do in plain English. AI will add the right tools to support that workflow.
Example prompts #
Browser #
- Add browser automation so this app can log into websites and take screenshots.
- Make this app open pages, click through flows, and extract data.
- Add a browser tool so this app can interact with dynamic websites.
OCR #
- Add OCR so this app can read scanned PDFs and images.
- Make this app extract text from receipts, invoices, and forms.
- Add document reading so this app can process image-based files.
Media #
- Add media processing so this app can convert audio and video files.
- Make this app generate thumbnails from uploaded videos.
- Add tools for trimming audio and extracting sound from video.
File conversion #
- Add file conversion so this app can turn documents into PDF.
- Make this app convert uploads into a standard format before processing.
- Add document conversion tools for user uploads.