Firebase AI Logic can run inference directly in Chrome. I looked into the underlying API to see how it works.

Hi, I'm Jeff.
I'm a web developer, and I work on Firebase at Google.
Posts
- On-device inference with Chrome's Prompt API and React
- Quickly deploy a static React app to Cloud Run
Using a simple Go server to serve a static React app
- Deploying a Zig web server to Cloud Run in ten seconds
Using Zig's cross-compilation and Cloud Run's OS-only base images for fast deploys.
- The React use api is not what I hoped it would be
My experience and thoughts trying out the React use API
- Add generative features into your app with Firebase AI Logic
An intro to using Firebase AI Logic in a web app.
- Trying the new <geolocation> HTML element in React
React doesn't support the new <geolocation> element yet, but I wanted to try it.
Experiments
These are some tools I've built for myself. Maybe they'd be useful to you too?
… see moreContact
Find me on LinkedIn to say hello.