I used a Sun Ray thin client on an airgapped network in my first job, working for the government. They were perfect for this.

No persistent storage, so no concerns about easily recoverable classified data sitting on desks. You could disconnect from your session and pick it up again in the other office across town, or just leave your stuff running overnight.