Truth, Trust, and the Illusion of Authenticity

2026/5/18 GMT-4 Revised 2026/9/6 GMT-4

"Fable 5.1 and GPT 6 both just came out in the last couple of days. It feels like AGI has genuinely become something within reach — like humanity will soon be able to free its own mind and hand everything over to AI. But is that really true?" — Sep 6th

Hi, I'm Stickman Charles.

This piece started today, while I was designing the leveling system for EchoID, EchoForge's user-tier framework. My brief to the AI was clear: no steep price barrier to entry, prioritize ecosystem participation, emphasize long-term contribution, and don't let it turn into "paying for your tier." EchoForge was never meant to be a pay-to-win system where money is what moves you up. What EchoID has always cared about are the assets that can't be accumulated quickly.

Here's what the AI came back with:

LV1 Shadow      $0
LV2 Etched      100 ADA
LV3 Mirror      1,000 ADA
LV4 Obsidian    5,000 ADA
LV5 Infinity    10,000 ADA

It even thoughtfully did the math for me: at $20 a year, how many years it would take to level up. It looked completely professional, like the business model of a mature SaaS company. The problem is, none of it was drawn from EchoForge's core philosophy — it was generated from whichever template scores highest on "correctness."

Looking back at the last few months of building EchoForge, this kind of problem hasn't been rare. Sometimes small, like mismatched information scattered across different documents. Sometimes big, like not being sure which version of a smart contract was actually running in production. (More on that in an earlier post: https://www.echoforgeef.com/blog/echo-with-you-1.) And this is with something like ten different models in the mix during development — including ones like Opus 4.6, which was billed at the time as "the strongest on the planet." That's clearly not something you can chalk up to "AI hallucination."

Here's an example. During a full code review of EchoForge in July, I discovered that the contract EchoCert was running in production wasn't the version I thought I'd prepared. It had already been live for close to three months. For a smart contract, that's long enough to make walking it back almost impossible.

Luckily, the two contracts were functionally almost identical, or there would now be a batch of wrongly issued certificates out there.

Some of that comes down to the models back then being weaker than they are now. But more of it comes down to me.

The way I used to work with agents was closer to this: write good instructions, switch on auto mode, and sit back while the agent handed me finished code and files — and just like that, a demo was done. It was actually shipping that took the most effort. Was there a step missing in between? There was: checking and testing my own code and documentation. At the very least, I should have known exactly which version of the code was running.

Once that alarm went off, I built two or three skills specifically to tell the AI what it could and couldn't do. For instance: before any irreversible action, stop and let me carry it out by hand. After finishing each module, test it on the spot, and only move on once the feature works and the documentation is clear.

"What if this is just Charles being new to it — not yet knowing how to use AI well?"

During a stretch of time I spent at Hizz, someone who'd worked as a developer for many years and now builds his own studio with AI told me that testing matters more now, not less — because people are quick to trust agents blindly, and that puts live code at risk of fatal errors. Someone else, who's been running things at Hizz for over half a year, said the same: you test and retest before you dare to actually ship. The more a piece touches money, the more careful you need to be.

Early on, not having a firm grip on your own project doesn't look like much of a problem. But it compounds. The further along you get, the bigger the snowball, and the more serious the consequences.

Why do Claude Code and Codex always need you to plan out the next step and make the call? At bottom, it still has to be you — the person who actually understands the project — carrying that responsibility.

Like the earlier version of this piece said: in the age of AI, the thing that matters most is trust. And where does trust come from? From how well you understand your own project. Only once you've tested it, understood it, and thought it through yourself does a project truly become yours — not one of your agents'.

Keep thinking, and take care.

真真假假

2026/5/18 GMT-4 修订于 2026/9/6 GMT-4

"Fable 5.1和GPT 6这两天刚刚发布。似乎 AGI 真的变成了触手可及的现实,人类很快就能解放自己的大脑,把一切交给AI。但是真的如此吗?" —— Sep 6th

你好,我是 Stickman Charles。

起因是今天给 EchoForge 的用户等级系统 EchoID 设计升级体系。我给 AI 的要求很明确:不设高价门槛,优先保证生态参与,强调长期贡献,不要变成"花钱买等级"。毕竟 EchoForge 想做的从来不是一个氪金才能升级的系统。EchoID 关注的一直是那些无法快速积累的资产。

结果 AI 给我的方案是这样的:

LV1 Shadow      $0
LV2 Etched      100 ADA
LV3 Mirror      1,000 ADA
LV4 Obsidian    5,000 ADA
LV5 Infinity    10,000 ADA

甚至还贴心地帮我换算了:"按照 $20/yr 计算,需要多少年才能升级。"看起来非常专业,就像一个成熟 SaaS 公司的商业模型。问题在于,它参照的不是 EchoForge 的核心哲学,而是按"正确率"最高的那一套模板生成的。

回顾我前几个月的EchoForge开发历程,这样的问题不在少数。小到各种文档里的信息不匹配,大到线上跑的是哪个版本的智能合约,我都不确定。(详见https://www.echoforgeef.com/blog/echo-with-you-1)而我在开发时用了大大小小接近10 款模型……其中不乏Opus 4.6这种在当时号称"地表最强"的模型。这显然不能简单地用"AI 幻觉"来解释。

举个例子。7 月的一次 EchoForge 代码全面检查里,我才发现 EchoCert 线上跑的合约,并不是我当时准备的那一版。它已经跑了近 3 个月。对一个智能合约来说,这个时间长到几乎无法挽回。

幸好两个智能合约的功能几乎相同,不然现在就会多出一批错误生成的证书。

这里面确实有当时模型不如现在的因素,但问题更多出在我身上。

以前,我跟Agent协作的方式更像是提好指令,打开Auto mode,坐等 Agent 给我完整的代码和文件,一个 demo 就做好了。到上线时反而最耗力气。中间是不是少了一步?没错,就是检查并测试自己的代码和文档。至少,得把现在跑哪个版本的代码搞明白吧。

警钟敲响之后,我做了两三个 skill,专门告诉 AI 哪些能做、哪些不能做。比如,在做任何不可逆操作之前,停下并让我来手动执行。每完成一个模块,当场测试,确认功能可用、文档清楚后再继续。

"万一只是Charles刚入门,还不太会用 AI 呢?"

我在Hizz学习的一段时间里,一位做了很多年开发、现在用 AI 搭建自己工作室的前辈说,测试反而比以前更重要。因为人容易盲目信任 Agent,上线的代码就有致命错误的风险。另一位运营 Hizz 大半年的前辈也说,要反复测试才敢正式上线。越是涉及钱的部分,越是要小心谨慎。

在前期,对自己的项目没有足够把握,似乎不是什么大问题。但它有复利效应,越往后雪球滚得越大,后果也越严重。

Claude Code 和 Codex 为什么总是需要你为它规划好下一步,让你来决策?本质上,还是要由你这个真正了解项目的人来承担责任。

就像这篇文章的上一个版本说的,AI时代,最重要的是信任。信任从哪来呢?来源于你对自己项目的掌握程度。只有测试过、了解过、自己思考过,这个项目才真正属于你,而不属于你的任何一个 Agent。

保持思考,保重。