It's been an epic few days: What happened?

Thursday, 04 April, Year 5 d.Tr. | Author: Mircea Popescu

Nothing much, just MtGox being too stupid to live.

Basically, MtGox has always sucked. Originally it worked as a game card trading site, to which the original owner (guy now involved with Ripple) hastily added Bitcoin and then simply gave it away to the current team (Mark Karpeles and co) for legal worriesi.

Then it leaked the userbase emails. To this day spam is sent to those addresses.

Then it started receiving reports that its security is compromised, from people who lost accounts. For two weeks they demured, blaming users for "using weak passwords". Then they were proper hacked, and Bitcoin was trading at 0.01 (because the attacker needed to lower the USD value to be able to steal their BTC because the limits in place were by USD-equivalent value).

If you were to make the list of "events which might have killed Bitcoin", MtGox's hack is indisputably at #1, above the Pirate heist, above the recent unexpected fork, above everything else. This is MtGox's legacy : they're a historical threat to Bitcoin's continued existence and a permanent nuisance in the day to day life of it. To further illustrate this point :

Mar 04 19:15:17 blu3gr1ffon ;;goxlag
Mar 04 19:15:22 gribble 106.133771 seconds

Mar 06 04:46:15 Ukto ;;goxlag
Mar 06 04:46:15 gribble 78.10124 seconds

Mar 06 05:17:03 Chaang-Noi ;;goxlag
Mar 06 05:17:05 gribble 456.476647 seconds

Mar 06 11:41:29 dub ;;goxlag
Mar 06 11:41:46 gribble 245.37453 seconds

Mar 07 01:58:34 kakobrekla ;;goxlag
Mar 07 01:58:37 gribble 471.638897 seconds

Mar 11 09:35:00 jurov ;;goxlag
Mar 11 09:35:01 gribble 2025.557307 seconds
Mar 11 09:35:10 jurov what is the record?

Mar 12 03:53:17 dub ;;goxlag
Mar 12 03:53:18 gribble 38.016469 seconds

Mar 12 04:12:36 smickles ;;goxlag
Mar 12 04:12:36 gribble 157.044926 seconds

Mar 12 04:23:10 gesell ;;goxlag
Mar 12 04:23:11 gribble 199.519792 seconds

Let's skip to recent times :

Mar 29 00:34:07 Bitesaak ;;goxlag
Mar 29 00:34:07 gribble 288.72481 seconds

Mar 29 00:40:41 thestringpuller ;;goxlag
Mar 29 00:40:41 gribble 167.450794 seconds

It's so bad we have a special command to query it! And it's so funny people have taken to embelishing it :

Apr 03 09:24:23 ThickAsThieves ;;goxlag
Apr 03 09:24:24 gribble MtGox lag is 219.524796 seconds. During this time, light travels 0.439925233262 AU. You could have sent a bitcoin from the Sun to Mercury (0.39 AU).

Apr 03 11:50:16 dub ;;goxlag
Apr 03 11:50:16 gribble MtGox lag is 468.536678 seconds. During this time, light travels 0.938942256714 AU. You could have sent a bitcoin from the Sun to Earth (1 AU).

Apr 03 17:52:42 TomServo ;;goxlag
Apr 03 17:52:42 gribble MtGox lag is 6048.679827 seconds. During this time, light travels 12.1214866489 AU. You could have sent a bitcoin from the Sun to Saturn (9.54 AU).

Apr 03 18:03:07 thestringpuller ;;goxlag
Apr 03 18:03:07 gribble MtGox lag is 5455.751923 seconds. During this time, light travels 10.933265768 AU. You could have sent a bitcoin from the Sun to Saturn (9.54 AU).

The notion that you're running an exchange with multisecond lag is ridiculous on its face. I'm not even sure why this has to be spelled out, it's beyond ridiculous. It's like Monty Python's cheese shop, it's like Monty Python's "self defense classes", it's like a comedy routine. This is what we use you for, MtGox, comedic relief. You're not an exchange, okay ? You're Bitcoin's very own Comedy Central.

So now, armed with this basic understanding of what's what and where we're standing, let us dissect MtGox's most recent load of bullcrap :

It's been an epic few days: What happened?
TOKYO - JAPAN - April 04, 2013

Dear Mt.Gox users and Bitcoiners,

It’s been an epic few days on Bitcoin, with prices going up as high as $142 per BTC. We all hope that this is just the beginning!

Not everything is epic, shitheads.

However, there are many who will try to take advantage of the system. The past few days were a reminder of this sad truth.

I dislike this on a personal note, because it smacks of the same sort of nonsense that regularly tries to depict speculators as "evil". Ie, whatever agents the free market uses to reduce group idiocy into a smoldering pile of debris are "taking advantage of the system", and "bad" and all that. Your mileage may obviously vary, I might just be oversensitive to low-level socialist thought process.

Mt.Gox has been suffering from its worst trading lag ever, 502 errors, and at one point some users were not able to log in their account. The culprit is a major DDoS attack against Mt.Gox.

Since yesterday, we are continuing to experience a DDoS attack like we have never seen. While we are being protected by companies like Prolexic, the sheer volume of this DDoS left us scrambling to fine-tune the system every few hours to make sure that things don’t go beyond a few 502 error pages and trading lag.

This was, of course, offered by way of warning in an older article on Trilema : Boys and girls, I got news : we’re being probed.

The sad news is that the attackers have apparently found their desired weak spot, are probably aware of this, which means they'll simply walk away, which will no doubt yield another round of vapid pats-on-the-back from "the team" adressed to "the team", congratulating each other that through their valliant efforts they've defeated the challenge. And then one day *bam* suddenly allovasudden and that's that.

Why has Mt.Gox become the target of a DDoS attack?
It is not yet clear who is behind this DDoS and we may never know, but these actions seem to have two major purposes:

• Destabilize Bitcoin in general. It is not a secret Mt.Gox is the largest Bitcoin exchange with more than 80% of all USD trades and more than 70% of all currencies. Mt.Gox is an easy target for anyone that wants to hurt Bitcoin in general.

• Abuse the system for profit. Attackers wait until the price of Bitcoins reaches a certain value, sell, destabilize the exchange, wait for everybody to panic-sell their Bitcoins, wait for the price to drop to a certain amount, then stop the attack and start buying as much as they can. Repeat this two or three times like we saw over the past few days and they profit.

These aren't too well thought through. For one, MtGox has seen ~2`876`000 BTC total volume in the past 30 days (all currencies), whereas all other exchanges together ~1`120`000 BTC (all currencies), which means they have about 70% of exchange trade. The OTC trade is in all likeliness a little larger than that, which gives them about a third of "all USD trades". Different beast.

For another, there's no "system", and moreover the recent events followed a different path from what MtGox feigns. Specifically, as price was approaching 150 I came out with a Ponzi warning. Bitcoin immediately retraced to ~130, and continued to downtrend for the rest of the day. The resulting spike in users is what caused MtGox' rather shoddy assemblage to fail, as by the time they were blinking in and out of existence the price had already dropped significantly and the trend was reversing. It's not really a case of "someone DDoS'd us to cause the price to fall", it's simply a case of BCB put out a warning, selloff ensued, Bitcoin's weakest point was once again flooded and unable to cope.

Since we are on this topic, I'd like to take the time and explain why I took the unprecedented measure yesterday of explicitly nixing a rally (something which I have never done before, I never gave any indication I'd ever do and hopefully will never have to do again).

The situation in the market was becoming macroeconomically concerning, in the following sense : major holders were done selling, the vast majority of trading action consisting of trades among newcomers brought in by the recent significant press exposure. These people had little if any understanding of Bitcoin and not much inherent interest in it other than "it's the new hot thing to make money online better get in at ground floor" sort of bullcrap. Having fiddy thousand such lemmings trading with themselves on ever-increasing nominal prices is practically a game of musical chairs, and in any case no different from the numerous "bitcoin gem" type Ponzis that have sprung up recently. Apparently this sort of nonsense is somehow very familiar and very comfortable to the clueless consumer mind.

The significant systemic risk in all this is that if price were allowed to run up to 500 or whatever idiocyii the subsequent crash would make Bitcoin look bad for no fault of its own and moreover allow idiots to run arround claiming they have "proof" that it's really a Ponzi. Well... here's the thing : anything can be used as a Ponzi. The original one was based on post stamps. You can use tulips, or seashells, or moonrock. And since you could be using anything else, go ahead and do so, Bitcoin is too valuable for this particular purpose, it'd be like using microscopes to hammer in nails to steal Datskovskiy's metaphor.

What can be done?
Believe it or not, there is pretty much nothing that can be done. Large companies are frequently victims of these kinds of attacks. Even though we are using one of the best companies to help us fight against these DDoS attacks, we are still being affected.

There are a few things that we can implement to help fight the attacks, such as disconnecting the trade engine backend from the Internet. By separating the data center from the Mt.Gox website, we will continue to be able to trade.

This happens to be the correct solution, as documented for their benefit by me, here. I am glad that they are applying the right solutions, and I do believe immitation is the sincerest form of flattery. It is however typical of human beings possesed of a spine to also give credit where credit's due. I have no problem crediting Datskovskiy his microscope, and it won't kill MtGox to say "we've learned something from MPEx". Not doing this doesn't particularly hurt me - everybody that matters already knows what's going on - but it does hurt their credibility, and that's important because credibility is the one thing they're running shortest on currently. Why paint yourselves as children any more than you need to, boys ?

What can you do?

I understand that many of you have a lot at stake here, but remember that Bitcoin, despite being designed to have its value increase over time, will always be the victim of people trying to abuse the system, or even the value of Bitcoin decreasing occasionally. These are not new phenomena and have been present since the beginning of time when humans first started trading.

This right here is an outrage, and I plainly demand an immediate apology from MtGox.

At issue is the misstatement that "Bitcoin was designed to have its value increase over time", which other than being grossly ignorant is also absolutely false. At issue also is the misstatement that "even the value of Bitcoin decreasing occasionally", which other than being grossly ignorant is also harmful to Bitcoin.

This is Ponzi talk, fuckwits. Bitcoin isn't a Ponzi. What are you doing here! Who are you! What are you for!

Trade Engine Lags
Lag affects everyone, not only us, but also major, world-renowned exchanges like the NASDAQ and NYSE. We can fix lag, but we cannot eradicate lag. Only small exchanges with low volume and liquidity are immune to lag.

This is a lie, inasmuch as no, I've traded on both NASDAQ and NYSE (unlike, presumably, anyone at MtGox ?) and I've never seen 10 minute lag. In fact subsecond delays are reportable events in many circumstances.

Account Verification
As if a major DDoS attack was not enough, we at Mt.Gox are victim of our own success!

This sort of glazy-eyed nonsense is not PR, it's simply offensive. It doesn't work to convince anyone that a failure teetering on the brink of blowing up every time the wind blows is successful. It just makes people wonder what exactly is going on in the mostly empty skulls of management signing off on such nonsense.

Last year, Mt.Gox saw an average of 9,000 to 10,000 new accounts created every month. This number doubled in January, tripled in February, and sextupled in March. In this month alone (March), over 57,000 new accounts were created!

Our support and account verification team went from four people in January 2012 to twenty-two people working every day of the week. We are now hiring even more people to solve this problem by finalizing some deals with external companies.

Remember that even if you are waiting for your account to be verified, you can still deposit or withdraw funds via our Japanese account and make your trades! (Only accounts that we pro-actively required to be verified are limited to deposits and trade only.)

This gently glosses over the Coinlab failure. To refresh memories, "Coinlab Bringing Bitcoin to Wall Street with MtGox Deal". This was supposed to have been trading already for about a week, yet the few brave souls who signed up for it haven't been as much as contacted yet.

That's not how you do PR, MtGox. Lying is not PR. Talking of "success" in the face of unmitigated, repeated and hopeless failure is not PR. Avoiding any mention of legitimate points of interest - such as for instance the status of projects you yourself announced - simply because the news isn't very good is not PR. Spinelessness is not an excuse, even if it is an explanation.

We have seen a significant amount of comments on the web (various forums, Reddit, etc.) that portray Mt.Gox as a company held by “idiots” and other rather rude words, complaining about inability to deal with lag and other system issues, without understanding the magnitude of work and attacks we are facing every day.

No, I understand the magnitude of your work just fine. I also understand the magnitude of your ineptitude. What now ?

I understand the frustration many of you feel. We hate this situation as well. Since we took over Mt.Gox, we have been through Hell and back and we are still here. We are still the largest exchange with over 420,000 trades per month and USD $121 million monthly trade volume. We have worked our way through all the requirements needed to run our exchange legally.

Except the time getting kicked out of France for failing to have consulted with legal counsel at all before being silly. And except the part where you'll be kicked out of the US soon too, seeing how CoinLab is dead and nobody's going to want to work with you there.

Anyone can jurisdiction-shop (and for that matter, Japan isn't even such a great choice). What you've failed to do is actually satisfy the legal requirements. The were the only ones to do that, but then apparently that's not enough either.

In all honesty - the big numbers on display count more as a weakness in my eyes. It's pretty obvious that competence doesn't scale, and there is such a thing as "lottery winner syndrome". Many cruddy businesses that somehow inexplicably survived while doing poorly suddenly imploded at the first whiff of doing well, and let's not forget MtGox only very recently (as in, months ago) dug itself out of the red.

Now, there are some things we can improve, but so far we are doing an incredible job that no other exchange has been able to do so far. While I understand a certain amount of frustration, realize what we have accomplished. I appreciate all the work you are doing everyday to push things forward and to help secure the future of Bitcoin.

In general MtGox' chief accomplishment has been leeching the community in the form of trade fees and contributing precious little in exchange. Hopefully they'll take the few millions that the community has given them this month and put it to better use than sponsoring dubious takeovers with a definite scent of conversion like that entire Bitcoin Magazine adventure. Hopefully they'll take the few millions that the community has given them and use it to build an actual exchange. One that, you know, works.

I guess time will tell.

  1. Jeb was in the US, Mark was not, that's all there was to it. Probably worth pausing to consider that the largest brake to innovation in Bitcoin right now is one's political status : if you're a free person you can make things, if you're a US subject you can't. Sucks to be the property of the United Soviets, doesn't it ? The implications are far reaching, too : one US company announced ASIC development in the Summer of 2012, two Chinese companies delivered ASICs in the Spring of 2013. []
  2. Who is that Blodget character by the way ? []
Category: Bitcoin
Comments feed : RSS 2.0. Leave your own comment below, or send a trackback.

15 Responses

  1. gheorghe`s avatar
    gheorgheinsigna de tehnologinsigna pentru 1000 de comentarii 
    Thursday, 4 April 2013

    D00d, bitcoin, by design, has a limited quantity. That means that when more people want to join the party, the value of bitcoin will grow. It may be ponzi talk, but they're only stating the truth :)

    I never thought I would ever see bitcoin at over $100, especially not so soon. I don't think the problem is necessarily that the people buying the bitcoins now are lemmings, but that bitcoin itself doesn't scale when given this kind of interest. It was pretty obvious that the value of bitcoin would skyrocket if it became really mainstream, like a few million people that need to buy food with it, they would buy all mtgox in a few seconds.

  2. Mircea Popescu`s avatar
    Mircea Popescu 
    Thursday, 4 April 2013

    Required reading.

  3. subSTRATA`s avatar
    Friday, 5 April 2013

    Not much difference between MtGox and BFL, it seems.

  4. Jeb was in the US, Mark was not, that’s all there was to it. Probably worth pausing to consider that the largest brake to innovation in Bitcoin right now is one’s political status : if you’re a free person you can make things, if you’re a US subject you can’t. Sucks to be the property of the United Soviets, doesn’t it ?

    Implying Government can't crack down on you any way, as it did with the piratebay pseudotvstars despite being Swedish.

  5. Mircea Popescu`s avatar
    Mircea Popescu 
    Thursday, 11 April 2013

    The "epic" few days continue over at MtFail. Here's a pastebin of the proceedings, because they're too victimised by their own success to be online (Hint : ).

    Being involved with Bitcoin is not only worth it for the Bitcoin, it's also worth it for the comedic relief.

  6. Well, I think they will lose transaction volume to other sites after the recent events. Unfortunately, that also means scams will flourish.

  7. Catalin`s avatar
    Friday, 12 April 2013


  8. Mircea Popescu`s avatar
    Mircea Popescu 
    Friday, 12 April 2013

    Heh. The press.

  1. [...] $10 per coin the previous Christmas, to over 200 that April, the same time Mt. Gox broke due to being a victim of their own success. Unfortunately this round of venture capital fed an addiction greater than heroin – Coinbase [...]

  2. [...] of deceitful communication. I will simply refer the curious reader to a recent case study titled "It’s been an epic few days: What happened?". That aside, on the balance of evidence MtGox is by a significant margin the most deceitful [...]

  3. [...] sticks together, many many levels of sophistication under this otherwise basic distinction (take MtGox' problems as a good illustration of the troubles Pan troglodytes is battling with). MPEx actually has [...]

  4. [...] I mention lagvi ? Or appallingly poor PR [...]

  5. [...] fly count. There were fewer then. ———Speaking of wild, unsubstantiated claims (the sort that made me ruin MtGox, let it be reminded) : Qntra chief editor has some curiosities re the Black [...]

  6. [...] its own paradigmii, the proposition is that Bitcoin will definitely go up. Because yeah, that's how Captn's O' Industree think and act. Even admitting, for argument's sake, the scammer's own twisted world... what sense [...]

  7. [...] altii ciuma. [↩]Well, only big one, at any rate. Or maybe not. [↩]You recall the "epic few days" era, the times of Karpeles and Keisers ? Look at all those coincidences, wooowee! [↩] [...]

Add your cents! »
    If this is your first comment, it will wait to be approved. This usually takes a few hours. Subsequent comments are not delayed.