A New Intelligence, A New Interface

Going past the Terminal (Again)

ai
design
Author

Sean Daly

Published

November 18, 2024

This is a favorite topic of mine at the moment, based on how I see people using AI chat interfaces like ChatGPT. There seems to be too much you can do, and too few constraints, so in a kind of paradox of choice it becomes very hard for people to do anything useful.

The Terminal: Why Don’t We Use It?

I remember being a kid in the days where you still had to be able to navigate DOS to get PC games to play. There was lots of dir, cd directory, dir, program.exe until you were eventually rewarded with a cascade of text and the first graphics introducing the start of the game.

The terminal still exists today, but regular users rarely even see it, and probably wouldn’t know the first thing about how to interact with it. Anyone in a tech role recognizes that this black screen with a blinking cursor gives you access to everything, in a much deeper way than a gui ever can.

If it is so powerful, why doesn’t everyone use it regularly? Well, you kind of have to know a long list of incantations to make it do what you want. Everything has to be precisely coded in, in a very precise way. The basics of navigation require ls and cd, making and deleting directories has mkdir, rm and rm -rf. That’s 4 (and a half) commands you have to just know for basic tasks that are “obvious” in a GUI.

Ordinary users moved away from the terminal because they don’t have to learn the incantations for every task they might want to do. GUI’s present everything to the user, with nicely signposted happy path that you just have to click on. A GUI actually presents a tradeoff, where we actually give up a lot of funcionality and optionality in the software we use in order to get something that does what we want with a lot less mental overhead.

Paper: Infinite Possibilities

Taking the terminal to the extreme, we could look at paper. Basically every work of literature, philosophy and discovery was written on physical paper up to just a few years ago. Paper and pen holds the nearly infinite capacity to record ideas, so potentially anyone can create any idea at any time on a piece of paper.

A terminal has a limit in that it can only run the programs that are installed on the computer. A piece of paper can take you in any direction, in any language, with pictures, diagrams or words. However, the lack of constraints means that you don’t just have to know incantations that give you shortcuts to complete tasks, you need to actually understand how to complete the entire task yourself.

AI: Beyond the Chat Interface

So, it seems that there is a trade-off here:

  • Terminal: great freedom, but need to understand terminal commands as shortcuts to complete more complicated tasks.
  • GUI: limited freedom, but often don’t need to know anything at all to achieve an outcome.

AI is generally at a point where, like a terminal, we are greeted by a flashing cursor, waiting for us to pilot it through a series of steps to complete a task. It is extremely powerful at taking our inputs and acting on them. However, there is a difficulty in knowing what the AI is capable of doing, and how to phrase your requests so that it actually does them. This can be seen in ChatGPT, where you need to know that, say, ChatGPT can generate pictures, and also that to do it you need to ask it to “make me a picture of..”.

There will be a new generation of AI apps that will be more GUI-like, and users will gravitate to them. Somehow, apps will be designed to drive the conversation, limiting the power of AI to do anything, but giving regular, non-ai-experts a greater ability to do something.

Solutions

The solution is to cut down on the number of options presented to users, and create “opinionated” software. Here’s a few ideas, ranging from more active user engagement to more passive:

  • GUIs: where we try to cut down the infinite possibilities to the point where a regular user can do something interesting with a couple of buttons.
  • Flipping the driving seat: so that instead of users coming up with the ideas, the AI is the one asking questions and driving the conversation.
  • Intent mapping: instead of having the user directly engage with the AI, the AI monitors their activity and behaviour, and tries to infer next best actions.
  • Filters: instead of actively engaging a user, the AI sits in the background selectively allowing or filtering information from the user.

Ultimate, there is a lot more work to do here. I don’t think we’ve yet found the form factor that makes most sense for AI.