
Posted on • Edited on • Originally published atbytehide.com
RIP Copy and Paste from Stackoverflow! 🚨 (+Trojan Source Solution)
According to a recent research byCambridge University's Nicholas Boucher and Ross Anderson, there aretwo vulnerabilities that impact most code compilers.
These sorts of vulnerabilities have animpact on software supply chains; for example, if an attacker successfully commits code injection by deceiving human reviewers, future software is likely to inherit the vulnerability.
But let's look at the technique:
Extended strings: make sections of string literals seem as code, having the same impact as comments and causing string comparison to fail.
Comment out: forces a comment to appear as code, which is then ignored.
Early returns: bypass a function by running a return statement that seems to be inside a comment.
What happens next?
The compilers support this unique code that you do not see, when compiling your application they interpret itcreating a compiled application different from the one you see in your IDE.
How Trojan Source works?
In this example Me (Juan) will be an attacker, imagine that I publish a solution in Devto teaching you how to do something (For example: I teach you how to check if a user is admin).
Let's suppose a different scenario, you or your company have anopen source project of something. I help you to develop some parts and I make a pull request with my contributions (I have provided a check so that certain action can only be done by Administrators, and you have added my code to your project).
Here you have theexample:
stringaccess_level="user";if(access_level!="user")//Check if admin{Console.WriteLine("You are an admin.");}
The vulnerability is that this code containsUnicode characters that your IDE does not show you, let's see this with a text editor that shows the hidden characters.
These characters modify the position, order, direction and so on of the text you see. So,what you see is not what it is.
You can read about how it works athere.
Well, now that you have accepted or copied my code, your project looks like this:
Apparently all is well, right?
Let's run the application then:
But…HOW?
If it's clear thataccess_level
is"user"
And we are comparing whether it isdifferent to"user"
So…
How the hell is"user"
going to be different from"user"
?
Because the compilationhas been done after interpreting the hidden characters.
Let's see this decompiled application(IL code):
As we can see in the compilation, the code is saying that if:
"user" ≠ "user // check if admin"
The Admin instruction will be executed:
Console.WriteLine("You are an admin.");
Obviously this is fulfilled, and it will be executed that we are admin (although in the source code we see the opposite).
Let's see the result of the compilation in C#:
Completely different from the original… (But you have not realized this and now I am going to take advantage of it to execute functions of Admin on your application although I am not).
This example is simple, but I caninject a thousand instructions like this on your application in production andthis is very dangerous.
How to solve it?
Fortunately, platforms likeGithub are warning users about this:
What should I do?
Interpreters, unicode-aware compilers and compiler pipelinesmust provide warnings or errors for unterminated bidirectional control characters instring literals or comments, as well as identifiers containing misleading mixed scripting characters.
Unterminated bidirectional string literals in comments and control charactersshould be explicitly forbidden by language requirements.
Mixed-script confused characters and bidirectional controlcharacters should be highlighted with visual warnings or symbols inrepository interfaces andcode editors.
How to check if I have been affected by this vulnerability?
It's all very well forGithub to start notifying us about this, but… What if it has already happened to us?
Thinking about what solutions we could take in our team, I thought not the best, but the simplest.
In the end, the vulnerability is aboutinjection of hidden characters in our source code, right, let's check if in our source there is any file thatcontains something hidden.
As you are probably a .NET developer (you are reading the article of a cybersecurity community for .NET) we are going tocreate a small tool in .NET, to check this problem in our projects (guess which ones?) YES! .NET.
Let's go 🚀
✅ Solution
First, let's checkhow to know if there are anyhidden characters in a file:
varnonRenderingCategories=newUnicodeCategory[]{UnicodeCategory.Control,UnicodeCategory.OtherNotAssigned,UnicodeCategory.Format,UnicodeCategory.Surrogate};
We use theenum
of theUnicodeCategory
we want to detect in our files.
We have more info on what they are inMicrosoft Docs.
As I have determined the unicode characters that could be associated with this vulnerability are of type:
Control: with a Unicode value of U+007F, either in the range of U+0000 to U+001F or U+0080 to U+009F.
OtherNotAssigned: Character that is not assigned to any Unicode category.
Format: A format character that affects the layout of text or the operation of text processing, but is not normally present.
Surrogate: Low substitute or high substitute character.
Now, the only thing we will do is, read a .cs
file (C# source code file) where this vulnerability can be found:
varnonRenderingCategories=newUnicodeCategory[]{UnicodeCategory.Control,UnicodeCategory.OtherNotAssigned,UnicodeCategory.Format,UnicodeCategory.Surrogate};usingStreamReadersr=newStreamReader(dotnetFile);while(sr.Peek()>=0){varc=(char)sr.Read();varcategory=Char.GetUnicodeCategory(c);varisPrintable=Char.IsWhiteSpace(c)||!nonRenderingCategories.Contains(category);if(!isPrintable{alert(dotnetFile);issuesCount++;break;}}sr.Close();sr.Dispose();
If the file contains one of these characters,we will suspect it.
Because the range of character types I have used is not exact, it may generatefalse positives if a file contains:
Characters from other alphabets, such asArabic: أعطني 3 تصفيق
Special characters such as emoji: 🦄
This solution will not be perfect, but it will warn you about possible problems and then you will evaluate if the file suffers the vulnerability.
This tool is finished and published in:TrojanSourceDetector4Dotnet
The tool allows you toscan one or more .NET projects for problems with this particular vulnerability.
As we at ByteHide are developers and we know how hard your life is, we offer you toinstall this tool through the console so that you don't have to do anything and check in a few seconds all your projects.
Just open yourCMD orPoweshell and type:
dotnettoolinstall--globalTrojanSourceDetector--version1.0.1
Now you will be able at any time to scan a directory where your .NET projects are located, to do this use:
TrojanSourceDetector
and when it asks you for the directory indicate thefull path.
For example place theCMD in your repository folder and run the command:
When finished, it will tell youwhich files may contain something suspicious:
and that's it!
All thanks tohttps://www.trojansource.codes/
@article{boucher_trojansource_2021,title={Trojan {Source}: {Invisible} {Vulnerabilities}},author={Nicholas Boucher and Ross Anderson},year={2021},journal={Preprint},eprint={2111.00169},archivePrefix={arXiv},primaryClass={cs.CR},url={https://arxiv.org/abs/2111.00169}}
Top comments(20)

- Pronounsshe/her;q=1, they/them;q=0.8, */*;q=0.2
- Joined
If you set the format of that last code block tobib
, the syntax highlighting will actually work ;)
@article{boucher_trojansource_2021,title={Trojan {Source}: {Invisible} {Vulnerabilities}},author={Nicholas Boucher and Ross Anderson},year={2021},journal={Preprint},eprint={2111.00169},archivePrefix={arXiv},primaryClass={cs.CR},url={https://arxiv.org/abs/2111.00169}}

Great article!
I recommend reading Russ Cox's post:
research.swtch.com/trojan
This is not new, its not specific to RTL LTR, and its also not something that should be "fixed" by compilers or language specs but rather by developer tools (like the one that you created). Stackoverflow should reject code that contains these characters.
In this 3 year old Go issue about the LTR / RTL vulnerability, one of the authors of UTF-8 (Rob Pike) voices the same opinion about putting fixes into programming languages / compilers:
github.com/golang/go/issues/20209#...

- LocationSpain
- WorkSoftware Engineer, Software Security at ByteHide
- Joined
Thank you for the article and your comment, you are right and I find it very interesting.
Thanks for the contribution!

- LocationEuropa
- EducationB.Sc. Mathematics and Computer Science
- Joined
Not the main reason, but one of the reasons I use Gremlins in VSCode:marketplace.visualstudio.com/items...
As you see in my screenshot, with this extension, my VSCode will detect the invisible chars.
dev-to-uploads.s3.amazonaws.com/up...
Mainly I need that, because I accidentally hit cmd + space when I'm typing fast, which results in a space that looks like a normal space, but is a non-ASCII char that can break code.
Other than that, I hope you will never use a negative check likeaccess_level != "user"
for real, since that will lead to side effects, once you have more access levels next to"admin"
and"user"
or any form of typos. Always make the check explicit:access_level == "admin"
.

- LocationSpain
- WorkSoftware Engineer, Software Security at ByteHide
- Joined
Thanks for discovering Gremlins, I liked it!
Regarding using the negative, yes, I wouldn't use it either but that was the example of the official article and the github repo, I just based on it.
Regards!

- LocationSpain
- WorkSoftware Engineer, Software Security at ByteHide
- Joined
Yes, but not all projects for example in some startups have complex unit tests for all aspects, obviously it is bad practice, but it is real. This is a simple 2 minute fix, but yes, you should have unit tests + test engineers. Thanks 💖

- LocationMountain View, CA
- WorkDeveloper Advocate at Google
- Joined
I think it would be possible to write malicious code that passes the unit tests. For example, what if the code in the article gave the user admin access if they are a legitimate admin or if their username is "fluffy-bunny"?

- LocationSpain
- WorkSoftware Engineer, Software Security at ByteHide
- Joined
It would be very easy to do, would you like to make a pullrequest with this change?
Just remove the break; when a character is found, and calculate the line based on: 1. last line index, 2. current character since last line.

I love it
X5O!P%@ap[4\PZX54(P^)7CC)7}$EICAR-STANDARD-ANTIVIRUS-TEST-FILE!$H+H

- Joined
Your first sample does not compile, I got
error CS1026: ) expected
while building withdotnet build
and also I see the error in VSCode.
I suspect it might depend of the file encoding
Some comments have been hidden by the post's author -find out more
For further actions, you may consider blocking this person and/orreporting abuse