Online education company · 10 employees, 95,000 support chats on record
AI customer support for an online education company: all 95,000 chats analyzed
We analyzed all 95,000 past support chats of an online education company and found 37 things to fix. We rewrote 130 help articles and simplified the support menu. In the first four days after the redesign, AI took 36 chats.
Before
A person handled every chat, so the first reply took 8 hours on average. The company paid a lot every month for its support software but was not using its AI features.
What we did
- Rewrote all 130 FAQ and help articles.
- Simplified a maze-like support menu.
- Let AI answer first. Money-sensitive cases such as refunds go to a person.
In their words
“The reason we pay so much for [our support software] is to use features like this. It has all of them, and we are not using any.”
— CEO, at the first meeting before starting (translated from Korean)
How it went
- Started by finding out why the AI features in the software they already paid for were not being used.
- Rewrote all 130 FAQ and help articles.
- Replaced a menu customers had to dig through with a simpler flow.
- AI answers first; anything involving money, such as refunds, goes to a person.
What we measured
We analyzed all 95,000 past chats and found 37 things to fix, including an 8-hour average wait for the first reply. In the first four days after the redesign, AI took 36 chats.
What AI does not do
AI does not answer money-sensitive cases such as refunds. They go to a person.
Where it stands
The software stayed the same; the help articles and menu were rebuilt. When we measured again in July, the number of chats AI finished on its own was still small. The rules and documents still need more work.