Jump to content

Evernote Service Down as of Jun 10, 2014 2:43 pm ET


JMichaelTX

Recommended Posts

  • Level 5*

Evernote Service Down as of Jun 10, 2014  2:43 pm ET

 

Per http://status.evernote.com/

 

 

Evernote Status
Jun 10, 2014 (2:43 pm PT)
[!] Evernote service accessibility issues

The Evernote.com service is currently unreachable; our Operations team is investigating the issue. We will provide updates as we learn more.

 

 

Seems to still be down as of Tue, Jun 10, 2014 8:25 PM ET -- attempt to sync fails.

Link to comment

The status page suggests a DoS (Denial of Service) attack and that they are working on it.  Best just to be patient...

 

[Edit] Sync appears to be working again as of 12:46 AEST (02:46 UTC, 19:46 Tue PDT)

Link to comment
  • Level 5*

WARNING!!!  Do NOT sign out of your local EN Client (Win/Mac)

 

I logged out of EN Mac 5.5.1 on one of my Macs just now, and it was a HUGE mistake.  Now I cannot access even my LOCAL copy of the sync'd Notebooks because I cannot sign back in.

 

This is a well-know use case solved decades ago by Microsoft.   If user login normally requires network (or Internet in this case) access to validate login credentials, BUT the network is DOWN, then the user is validated from a local cache of credentials (encrypted, of course).

 

A PRIMARY requirement is that the user must be able to access his/her local copy of sync'd Notebooks even if the Network/Internet or Evernote Service is DOWN.

Link to comment

Hi all...

Evernote for Windows on my desktop computer will not sync. I click on the sync button and it runs for several minutes, then stops, and the Sync button has a red circle with an exclamation point in it. (see screen shot in the attached file). I am using Windows 7, and it is fully-updated.

 

Evernote is current as well, i am using version 5.4.0.3698 (271698) Public

My Nexus 10 tablet will not sync either. it is using Android 4.4.3 and Evernote version 5.8.4

 

Any suggestions?

 

And thanks in advance for the help.

-Richard

 

Here is my activity log:

Log opened on 2014/06/11 00:30:13 (UTC-7:00)

00:30:13 [6672] Command line: "C:\Program Files (x86)\Evernote\Evernote\Evernote.exe" /Hide
00:30:13 [6672] Client info: Evernote Windows/271698; Windows/6.1.7601 Service Pack 1;
00:30:13 [6672] Bootstrap info: Evernote (loadedLastUsed)
00:30:14 [6988] Requesting bootstrap info from "www.evernote.com" (en-US)
00:30:14 [6988] 0% Connecting to www.evernote.com/edam/user
00:30:15 [6988] Bootstrap info: request to "www.evernote.com" returned profiles: Evernote
00:30:15 [6988] Bootstrap info: Evernote (loadedFresh)
00:30:25 [6672] Opened database: C:\Users\Richard\AppData\Local\Evernote\Evernote\Databases\rmruby.exb (1.1GB Fixed)
00:30:25 [7844] Import folder: "D:\Evernote" started, ImportOneLevelDeep
00:30:25 [7848] Import folder: "D:\Documents\Save" started, ImportOneLevelDeep

Log opened on 2014/06/11 00:31:28 (UTC-7:00)

00:31:28 [7972] Command line: "C:\Program Files (x86)\Evernote\Evernote\Evernote.exe"

Log closed on 2014/06/11 00:31:28 (UTC-7:00)

00:31:29 [6672] Command line: "C:\Program Files (x86)\Evernote\Evernote\Evernote.exe"
00:31:37 [7908] Client synchronization started
00:31:37 [2472] 0% Connecting to www.evernote.com/edam/note/s156
00:31:37 [2472] 0% Loaded updateCount: 29767
00:31:37 [2472] 0% Usage Metrics: sessionCount=1
00:31:37 [2472] 0% Client is up to date with the server, updateCount: 29767
00:31:38 [2472] 0% Updating server items
00:31:38 [2472] 0% Creating server note "634 Franke Dual Point Drawing.pdf", resource count: 1
00:34:07 [2472] 0% Can't send HTTP request, error: INTERNET_CANNOT_CONNECT
00:34:07 [7908] Client synchronization finished, status: failed
00:34:07 [7908] * error: Could not connect to Evernote service
00:34:07 [7908] * elapsed time: 2m 30s
00:38:14 [6672] Launching url http://evernote.com/about/support/windows.php
00:39:21 [5060] AutoUpdate: checking for update at: https://update.evernote.com/public/ENWin5/update.xml
00:39:22 [5060] Received status code 200 when accessing URL https://update.evernote.com/public/ENWin5/update.xml
00:39:22 [5060] AutoUpdate: no update found, remote revision is the same as the local revision (271698)
00:39:22 [5060] Received status code 200 when accessing URL https://update.evernote.com/public/ENWin5/ReleaseNotes_5.4.0.3698_en-us.html
00:47:15 [5336] Client synchronization started
00:47:15 [3852] 0% Connecting to www.evernote.com/edam/note/s156
00:47:15 [3852] 0% Loaded updateCount: 29767
00:47:15 [3852] 0% Usage Metrics: sessionCount=0
00:47:15 [3852] 0% Client is up to date with the server, updateCount: 29767
00:47:15 [3852] 0% Updating server items
00:47:15 [3852] 0% Creating server note "xxxxxxxxxxxxxxxxxxx", resource count: 1

Log opened on 2014/06/11 00:48:21 (UTC-7:00)

00:48:21 [3216] Command line: "C:\Program Files (x86)\Evernote\Evernote\Evernote.exe"
00:48:21 [3216] Client info: Evernote Windows/271698; Windows/6.1.7601 Service Pack 1;
00:48:21 [3216] Bootstrap info: Evernote (loadedLastUsed)
00:48:21 [7944] Requesting bootstrap info from "www.evernote.com" (en-US)
00:48:21 [7944] 0% Connecting to www.evernote.com/edam/user
00:48:21 [3216] Bootstrap info: Evernote (loadedDatabase)
00:48:21 [7944] Bootstrap info: request to "www.evernote.com" returned profiles: Evernote
00:48:21 [7944] Bootstrap info: Evernote (loadedFresh)
00:48:21 [3216] Opened database: C:\Users\Richard\AppData\Local\Evernote\Evernote\Databases\rmruby.exb (1.1GB Fixed)
00:48:21 [7908] Import folder: "D:\Documents\Save" started, ImportOneLevelDeep
00:48:21 [4220] Import folder: "D:\Evernote" started, ImportOneLevelDeep
00:49:05 [4048] Client synchronization started
00:49:05 [6672] 0% Connecting to www.evernote.com/edam/note/s156
00:49:05 [6672] 0% Loaded updateCount: 29767
00:49:05 [6672] 0% Usage Metrics: sessionCount=1
00:49:05 [6672] 0% Client is up to date with the server, updateCount: 29767
00:49:05 [6672] 0% Updating server items
00:49:05 [6672] 0% Creating server note "xxxxxxxxxxxxxxxxxxxxxx.pdf", resource count: 1

Log opened on 2014/06/11 00:50:49 (UTC-7:00)

00:50:49 [1532] Command line: "C:\Program Files (x86)\Evernote\Evernote\Evernote.exe"
00:50:49 [1532] Client info: Evernote Windows/271698; Windows/6.1.7601 Service Pack 1;
00:50:49 [1532] Bootstrap info: Evernote (loadedLastUsed)
00:50:49 [8148] Requesting bootstrap info from "www.evernote.com" (en-US)
00:50:49 [8148] 0% Connecting to www.evernote.com/edam/user
00:50:50 [1532] Bootstrap info: Evernote (loadedDatabase)
00:50:50 [1532] Opened database: C:\Users\Richard\AppData\Local\Evernote\Evernote\Databases\rmruby.exb (1.1GB Fixed)
00:50:50 [6524] Import folder: "D:\Documents\Save" started, ImportOneLevelDeep
00:50:50 [7588] Import folder: "D:\Evernote" started, ImportOneLevelDeep
00:50:54 [2716] Client synchronization started
00:50:54 [7416] 0% Connecting to www.evernote.com/edam/note/s156
00:50:54 [7416] 0% Loaded updateCount: 29767
00:51:02 [8148] 0% Can't send HTTP request, error: INTERNET_TIMEOUT
00:51:02 [8148] Bootstrap info: request to "www.evernote.com" failed, error: timeout
00:52:57 [1532] Opened default external editor for resource 44699/0, file "C:\Users\Richard\AppData\Local\Evernote\Evernote\Databases\Attachments\xxxxxxxxxxxxxxxxx.xlsx"
00:53:04 [7416] 0% Can't send HTTP request, error: INTERNET_CANNOT_CONNECT
00:53:04 [2716] Client synchronization finished, status: failed
00:53:04 [2716] * error: Could not connect to Evernote service
00:53:04 [2716] * elapsed time: 2m 9s
01:08:04 [7468] Client synchronization started
01:08:04 [924] 0% Connecting to www.evernote.com/edam/note/s156
01:08:04 [924] 0% Loaded updateCount: 29767
01:08:05 [924] 0% Usage Metrics: sessionCount=1
01:08:05 [924] 0% Client updateCount: 29767, server updateCount: 29769
01:08:05 [924] 0% Retrieving list of changes from the server
01:08:05 [924] 0% * saved 1 sync chunks, updateCount=29769
01:08:05 [2780] 0% Synchronizing 2 preferences
01:08:05 [3772] 50% Connecting to www.evernote.com/edam/note/s156
01:08:05 [3772] 50% Retrieving 1 note
01:08:05 [3772] 50% Retrieving note "xxxxxxxxxx"
01:08:05 [3772] 50% * guid={3435c971-3e22-4547-a7cd-ded0492af635}
01:08:05 [3772] 50% * note content, length=229
01:08:05 [2780] 100% Creating local note "xxxxxxxxxxxxxx", resource count: 0
01:08:05 [2780] 100% * guid={3435C971-3E22-4547-A7CD-DED0492AF635}
01:08:06 [924] 14% Updating server items
01:08:06 [924] 14% Creating server note "xxxxxxxxxxxxxxxxxxxxx.pdf", resource count: 1
01:10:55 [924] 14% Can't send HTTP request, error: INTERNET_CANNOT_CONNECT
01:10:55 [7468] Client synchronization finished, status: failed
01:10:55 [7468] * error: Could not connect to Evernote service
01:10:55 [7468] * 1 item received
01:10:55 [7468] * elapsed time: 2m 50s
 

post-206048-0-06197300-1402474443_thumb.

Link to comment
  • Level 5*
01:10:55 [924] 14% Can't send HTTP request, error: INTERNET_CANNOT_CONNECT

01:10:55 [7468] Client synchronization finished, status: failed

01:10:55 [7468] * error: Could not connect to Evernote service

 

As you may know Evernote had some problems last night.  Try again?  (And please don't post logs directly in the forums,  they're fine as attachments.)

Link to comment
  • Level 5*

I'm guessing that all devices can be effected.

 

I can sync fine, but it might be geographic or server specific - I've no idea what their incoming traffic and load balancing looks like.

Link to comment
  • Level 5

My Evernote account was shut down for most of the evening last night.

Woke up this morning, can sync, but the current Status is:

 

- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - 

status.evernote.com

 

[=>]An update on the service disruption
We're actively working to neutralize a denial of service attack. You may experience problems accessing your Evernote while we resolve this.
- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - 
 
This problem should make for some interesting reporting on the tech sites once the dust settles.
 
 
Edit: Here are few articles already.
 
Forbes:
"The reason for the attack is not known, and the problem is  the latest in a string of security questions Evernote has faced."
 
PCWorld
Link to comment
  • Level 5

I was able to sync earlier today, but have been shut off for the past hour or so.

 

Evernote Clearly is not able to capture websites at this time.

Rather than wait and hope for a quick solution, I am copying the URL's I want and pasting them into Google Keep for safekeeping. When Evernote comes back on line, I will be able to decide what to do with the information.

Link to comment

I never lost access to EN during the attack yesterday, but think that is because I am a premium member and have offline access on my iphone.  I do have to say I was very PLEASED with Evernote for being so honest and forthcoming with updates and for dealing with the attack on their end very agressively.  

 

Like it or not, these types of attacks are just part of the digital world we all now live in and it makes me feel good about my choice to entrust Evernote with my data when I see how swiftly they dealt with this threat.

Link to comment
  • Level 5

I am also a Premium subscriber. Fortunately, I took JMichael's original advice and did not log off from my Windows client. I can see my past notes in Evernote with my desktop computer.

 

But I am not able to capture new information. That is why it is helpful to have other programs available. For safety, I don't put all my eggs in one basket. Google Keep is my alternate and filling in very nicely right now.

Link to comment

Just a quick update--we're continuing to see sporadic sync issues from users across the service--these are all still aftereffects from yesterday's DDoS attack. Give the service until EOD and most remaining sync issues should be resolved. We'll be conducting some spot checks with users who've still reported sync issues around EOD to see how they're coming along.

Link to comment
  • Level 5*

Very strange, I've got three computers, all on the same network. One of them syncs just fine but the other two are giving errors about cannot connect to the server.

 

I had the same issue last night.  As of now, all my Macs are connecting/syncing with Evernote.

Link to comment

With these intermittent issues--may try another network connection if you can. If it's ongoing EOD we'll begin to grab IP Addresses and get them to our higher tier support team. 

Link to comment

With these intermittent issues--may try another network connection if you can. If it's ongoing EOD we'll begin to grab IP Addresses and get them to our higher tier support team. 

And remember, fellow users, EOD/End of Day is pacific time, so that might mean much later than End of Day in your region! 

Link to comment

My home PC synced okay this morning but I've been unable to sync my work PC at all today. My work PC synced yesterday at 1:00 PM PDT, then failed at 3:29 PM, 4:28 PM and 5:27 PM. I got a successful sync in at 5:54 PM then failures for the rest of the night and into today. 

 

Nothing I can do about my network connection since I'm stuck with what I got. Hoping the inability to sync is related to yesterday's issues and not anything to do with my company's firewall or proxy servers or whatever it is they use to keep us from accessing YouTube and Facebook. Will wait it out and hope for things to resolve later today but wanted to post an update so those in the same boat know they're not alone (what with misery loving company and all that...)

 

Thanks for all the hard work EN team!

Link to comment
  • Level 5*

Well, I WAS able to connect to the Evernote Service this morning, but now I cannot:

 

 

Evernote is unable to connect with the Evernote Service. This may be due to a network problem or service maintenance. Please try again later. If enabled, automatic synchronization will resume once the Service becomes available.

 

Reporting from the Houston, TX area, if that makes any difference.  Comcast is ISP.

 

Unable to connect/sync.

Link to comment
  • Level 5

Well, I WAS able to connect to the Evernote Service this morning, but now I cannot:

 

 

Evernote is unable to connect with the Evernote Service. This may be due to a network problem or service maintenance. Please try again later. If enabled, automatic synchronization will resume once the Service becomes available.

 

Reporting from the Houston, TX area, if that makes any difference.  Comcast is ISP.

 

Unable to connect/sync.

 

 

Ditto for me in Minnesota - using Charter Communications - Evernote down last night and most of today.

 

 

However, Evernote status screen indicates the problem has been solved.

 

"Evernote service is available. Ongoing mitigation of the DDoS event means a very small number of users may see login problems today."
Link to comment
  • Level 5*

I am still not getting Jack for syncing here and we have 15+ people in the office on an Evernote business account. Nothing is working besides the smallest of text only notes. No attachments at all are working before we get timeouts.

 

And what about emails sent to our Evernote address? Those aren't showing up in the web client either. Are they getting dropped or just in some massive email queue somewhere?

Link to comment

Do Evernote devs know they are not the only ones? Feedly is down as well from a DDoS.

 

Denial of service attack
Posted on  June 11, 2014 by @feedly

2:04am PST – Criminals are attacking feedly with a distributed denial of service attack (DDoS). The attacker is trying to extort us money to make it stop. We refused to give in and are working with our network providers to mitigate the attack as best as we can.

We are working in parallel with other victims of the same group and with law enforcement.

We want to apologize for the inconvenience. Please know that you data is safe and you will be able to re-access your feedly as soon as the attack is neutralized.

We will update this blog post as soon as we have more information:

Thank you for your understanding,

/Oliv, Seb and Edwin

Link to comment

Here's my situation:  I primarily use the EN app on my MacBook.  Last night (and throughout the day today), I've made several additions to existing notes, hit sync, and received the failure message that JMichael displays above.  However, when I check the EN app on my phone, I have all of the updates to my notes.  Same when I check my EN account via the web service.

 

So, the MacBook app continues to inform me that syncing has failed (which also prevents me from using the Note Link functionality), but syncing does appear to be taking place. 

 

Odd.

Link to comment

I had guessed that was the case with Feedly. I couldn't access it earlier today, and it was just too much of a coincidence.

 

Update on my EN connection/sync status: now none of the computers on my home network can connect. 

My work laptop was able to connect through my VPN earlier today but now is unable to connect.

My iPhone and iPad are connecting and syncing fine.

Link to comment

In Tyler, TX, can't sync Evernote Windows, Evernote iPad, or Evernote Android via local WiFi.  But was able to sync all 3 platforms via Verizon phone data tether.  So some traffic is apparently being blocked.

 

If the server IP address has been changed, I'm wondering if DNS servers have to be updated with the latest info.  Probably still pointing to the old address.

Link to comment

Thanks for the continued updates everyone, and also for the continued patience. We're working on it to ensure everyone regains full service very soon.

Link to comment
  • Level 5

Thanks for the continued updates everyone, and also for the continued patience. We're working on it to ensure everyone regains full service very soon.

 

Minnesota reporting in... I am back up and running smoothly.

Link to comment
  • Level 5*

My clients are syncing much better now, but I am still missing a number of emails that were sent in. Are those lost forever or in a queue somewhere?

Link to comment
  • Level 5*

Notes I have directed to EN through email don't seem to be arriving as yet.  Others seeing the same?  Backlog of emails to process or issue?

Link to comment
  • Level 5*

I am still not getting Jack for syncing here and we have 15+ people in the office on an Evernote business account. Nothing is working besides the smallest of text only notes. No attachments at all are working before we get timeouts.

 

And what about emails sent to our Evernote address? Those aren't showing up in the web client either. Are they getting dropped or just in some massive email queue somewhere?

Same issue with me, emails not making it to Win desktop or iClients.

Link to comment
  • Level 5*

All of my Macs are now connecting/syncing.  I am seeing normal operations including:

  1. Web clippings (FF and Chrome) are being sync'd
  2. EMails forwarded to my EN EMail address are being received/sync'd properly

Lesson Learned:  Make sure I have the needed Notes set in OFFLINE Notebooks on my mobile devices (iPhone/iPad)

Link to comment
  • Level 5*

Thanks for the continued updates everyone, and also for the continued patience. We're working on it to ensure everyone regains full service very soon.

 

Thanks for staying on top of this Geoff, and keeping us informed.  In times of crisis, good, clear communications are most helpful, if not essential.

Link to comment

Inbound emails to the service are likely clogged up a bit post attack--give them a minute. Juuuuust in case though I'm checking with our Ops team on this. Glad to hear syncing is beginning to become "unstuck" for some of you. We're going to continue to monitor and take steps to ensure all of you are back online ASAP.

Link to comment

They are on top of things. Just got confirmation that inbound email lag is due to the DDoS; the email should be queued and will slowly be processed.  Sorry for the delay!

Link to comment
  • Level 5*

They are on top of things. Just got confirmation that inbound email lag is due to the DDoS; the email should be queued and will slowly be processed.  Sorry for the delay!

 

Thanks GBarry. Hopefully they will clear tonight.

 

I look forward to the debrief blog post your team often does after any major system event. What happened, lessons learned, how it will be avoided in the future, etc. Those are often very informative and interesting reading. 

Link to comment
  • Level 5*

I got some files today that took 21hrs to go through. One that was emailed 2.5hrs ago still hasn't arrived, so it seems there is still a backlog to process, but the good news is as far as I can tell, nothing has been lost. Just delayed.

Link to comment

I'm having "weird" problems today, where I created a note on my mac, then sync'd, then to my pc, sync'd, LOOKS like it sync'd, but note did not come.  Then sync'd on another pc, the new note arrive, back to other pc, sync, still nothing.  Some time later, sync, and the note appears. Is this part of the DDOS or something else?  I've never had this behaviour before.  Very strange! (incidentally, NO errors on sync at all... it "looks" as though sync has done its thing perfectly... BUT IT HASN'T...

Link to comment
  • Level 5*

EN just updated that this is a big issue right now and the delay time is hours. I had an email sent at 3am (system email) that I still don't have in Evernote, so we are approaching a 9hr window so far. It has a 10MB attachment, so I am not sure if text emails are getting through faster than attachments or not.

 

http://status.evernote.com/

 

 

Jun 12, 2014 (11:39 am PT)

[=>] Known issue: inbound email delays

We have a large backlog of inbound email into the Evernote service. This will delay the time it takes for email to show up in your Evernote account. We are working on increasing the processing speed but there may be delays of several hours. We appreciate your patience while we work through this issue.

Link to comment
  • Level 5*

I am at the 18-21 hour mark on several notes that were mailed in. Evernote clearly needs to improve its capacity to recover from such events.

 

Well, I think the issue is to not get behind in the first place.  :D

Link to comment

New ones are coming through quickly, but ones from hours ago still not in. I assume the incoming pipeline is now clear, but the backlog is still clogged. Those are technical terms, btw

Link to comment
  • Level 5*

New ones are coming through quickly, but ones from hours ago still not in. I assume the incoming pipeline is now clear, but the backlog is still clogged. Those are technical terms, btw

 

Well, technical problems demand technical solutions. The Internet Pipe Scrubber would fix this in mere minutes. 

Link to comment
  • Level 5*

My 3am email yesterday took 21hrs to arrive. The 3am email today I got in 11hrs, so it is improving, but still a ways to go. 

Link to comment

Have not been able to sync for the last ~4 hours

 

The service outage to which this thread refers was resolved last week. If you're having issues, I'd recommend 1) starting your own thread as it's quite likely your problem is unrelated and B) possibly submitting a support ticket (the link is in my signature).

 

When you start your own thread, it would be helpful if you included what platforms (e.g. Windows, iOS, etc) you're using Evernote on. 

 

Best of luck. 

Link to comment
  • 3 weeks later...

i'm having this same issue for approx the past 24 hours.  My desktop EN won't synch with the web EN.  It says "cannot connect to the evernote service".

 

Status.evernote.com doesn't show any issue.

 

Please help.

Link to comment
  • Level 5*

There's no global issue that I'm aware of - I'd suggest switching everything off and on again later;  you may be having problems related to your service provider or Evernote might have some busy periods.  If you're still stuck after a restart,  raise a support ticket (see below).

Link to comment

Except that a few hours later I'm having the same problem again.  After exitting and restarting it works again.....there must be something wrong somewhere.  I've been using evernote for years and for two years at least on this particular computer.  This is the first time I'm having this problem and nothing has changed on the computer (at least not intentionally.....).

 

Any ideas?

Link to comment

Hmmm no ideas, syncing has worked fine for me all day (and all week so far). Have you submitted a support ticket? You could try some troubleshooting yourself by looking at the activity logs to see what might be holding things up. 

 

 

EDIT:

Some other users appear to have seen some snags:

https://discussion.evernote.com/topic/63369-syncing-problem/#entry289323

 

Could be something affecting a few random users.... 

Link to comment

Archived

This topic is now archived and is closed to further replies.

×
×
  • Create New...