Shopping for clothes in person is an entirely different experience than shopping online (and only being able to guestimate how their purchase may look or fit in real life), but we wanted to evaluate the online shopping reliability of two of these brands when it comes to the world wide web and their own individual website performance.

To test their web performance quality, we used AlertBot’s external website monitoring system and its TrueBrowser™ technology to monitor both GAP.com and Aeropostale.com from August 4th through August 18, 2019. (We originally planned to evaluate Abercrombie.com instead of Aero, at first, but the site produced so many errors that we decided to choose a different company’s site to monitor.)

Reliability

For the reliability evaluation of a website, we look for failure events (like when a page doesn’t fully load or it is completely down), and we look for what caused those failures.

Both Aero’s and GAP’s sites achieved 99% uptime. Neither saw significant downtime, which is expected, but each one experienced some sluggish speeds and even load time timeouts on a couple occasions.

Aeropostale.com experienced 99.64% uptime, with over 20 errors recorded due to slow load times or brief periods of unresponsiveness. None of these events lasted longer than a couple minutes, however, and none of them amounted to any significant downtime. Because of this, we still consider their performance to be pretty good.  (Aeropostale.com 8/10)

GAP.com experienced fewer issues, but struggled with some significant slowness on August 9th, resulting in 99.50% uptime. Otherwise, they would have an overall stronger performance during this time period than Aero. (GAP.com 8/10)

Speed

When evaluating a website’s speed, we look at the time it takes the site’s homepage to render and load to the point of being fully interactive by the user. These tests are performed from the perspective of a first-time visitor with no prior cache of the website’s content. AlertBot runs the tests inside real Firefox web browsers using AlertBot’s TrueBrowser™ monitoring. We calculate the speed as an overall average across all locations during the time span selected for this Showdown.

When it comes to page load times, Aeropostale performed respectably, but at about twice the load time as GAP’s site. Their best day, on average, was Monday, August 5^th with 6.1 seconds. Their worst day, on average, was Thursday, August 15^th, with 6.8 seconds. The site’s overall average speed across the entire test period was 6.97 seconds, which isn’t terrible, but it also isn’t much to brag about. However, one thing certainly gleaned from these results is that Aero’s site is relatively consistent across the board, in regards to their speed.  (Aeropostale.com 7/10)

As teased above, GAP.com performed about twice as fast as Aeropostale.com did. Their best day, on average, was Sunday, August 4^th with 2.4 seconds. That’s a pretty decent load time. GAP.com’s worst averaged day was Friday, August 9^th, at 3.35 seconds, which is still almost half the time of Aero’s best day. The site’s overall average speed across the entire test period was 2.8 seconds, which is rather impressive.     (GAP.com 8.5/10)

Geographic

It’s always interesting to see how sites perform differently across the world. If we look exclusively at the United States, it’s intriguing to see which states regularly see faster or slower times than others. For this portion of the test, we compare the overall average speeds of each individual location captured during the selected period of time for this Showdown.

When it comes to geographic performance, it seems safe to say that Aero’s site is all over the map. They performed best in North Carolina at an average of 2.6 seconds, with Nevada in second at 3 seconds and Oregon third at 3.1 seconds. Those times are not bad at all. However, their slowest time was a dismal 13.3 seconds (ouch!) in Missouri, followed by 13 seconds in California, and Washington DC in third place at 12.1 seconds. (Aeropostale.com 7/10)

GAP.com also saw some drastic differences on either side of the scale, but not nearly as substantial a difference as Aero’s. Their fastest average performance was seen in Nevada, at 1.7 seconds. Oregon came in second at 1.7 seconds, and Virginia was third at 1.8 seconds. Missouri was once again at the bottom of the proverbially bargain bin with 6.3 seconds, followed by Colorado at 5.21 seconds and Texas at 5.17 seconds. Still, GAP’s geographically slowest times look like Aero’s overall fastest times, which is rather disappointing.  (GAP.com 8.5/10)

Usability

For evaluating a site’s usability, we always select a common task a user might typically try to accomplish when visiting the sites and replicate it. For our previous Showdowns, we tested things like going through the motions of ordering movie tickets from a local theater or simply adding a similar item to both sites’ shopping carts. For this Showdown, we’ll see what the experience is like to use their respective websites to see if we can find a nice sweater (since we’d love to cozy up in this fall weather) and add it to our cart.

For each of these processes, we started by opening a new tab in Google Chrome and typing in the site’s URL.

From the point of typing www.GAP.com into our Chrome browser, it took 39.10 seconds and 8 clicks to get a sweater into the shopping card and begin the checkout process. GAP had two pop-ups about coupons and joining their mailing list, and it took a few clicks to get around those. Then we navigated to the Men’s section, selected the first long sleeve crewneck we found and added it to the cart. (And hey, it’s 40% off, too. Woohoo!)

For www.aeropostale.com, it took 6 clicks and 35 seconds to browse their fall collection, snag a thermal hoodie tee, add it to the cart, and click checkout (and hey, the price was about half-off, too!).

Honestly, both sites are pretty nice, easy to use, and straightforward. The pop-ups on GAP.com were a bit annoying, especially with there being two of them, but it’s tough to gripe about getting offered coupons to save money when you’re shopping. Aero’s site felt just a smidge more inviting, like you’re browsing a tangible catalog, and it seemed to offer quite a few options up front.

All things considered, our Usability scores are:

(Aeropostale.com 9/10)
(GAP.com 9/10)

Verdict

Both sites performed respectably, but when it comes to speed, one definitely outperformed the other—and the positive usability experience is just gravy. So, we’re pleased to announce this Showdown champion to be…

Winner:

As technology continues to morph change with the times, the virtual reality experience keeps becoming more widespread and immersive. Two of the leading brands in the VR game are unmistakably VIVE (HTC) and Oculus. Both companies are leaders in the ever-expanding digital world of virtual reality, with both having released or having plans to release new headset models this summer.

While these brands may corner the market on connecting to the virtual realm, we wondered how they stack up when it comes to the world wide web and their own individual website performance.

To test their web performance quality, we used AlertBot’s external website monitoring system and its TrueBrowser™ technology to monitor both VIVE.com and Oculus.com from May 1^st through May 22, 2019. Given the high regard in which these companies are held because of their products, we expected their web performance to be strong.

Reliability

For the reliability evaluation of a website, we look for failure events (like when a page doesn’t fully load or it is completely down), and we look for what caused those failures.

Both VIVE’s and Oculus’s sites did perform quite well. Neither saw significant downtime, but each one experienced some sluggish speeds and even load time timeouts on a couple rare occasions.

VIVE.com experienced 99.91% uptime, with just a few errors recorded due to slow load times. None of these events lasted longer than a couple minutes, and none of them amounted to any significant downtime. Because of this, we still consider their performance to be quite solid.  (VIVE.com 8/10)

Oculus.com performed similarly with 99.98% uptime and similar slow page load errors that didn’t amount to significant downtime but at least put a minor hiccup in their performance. They experienced four times fewer of these errors than VIVE, so they ended up coming out just a tiny bit more on top. (Oculus.com 8.5/10)

Speed

When evaluating a website’s speed, we look at the time it takes the site’s homepage to render and load to the point of being fully interactive by the user. These tests are performed from the perspective of a first-time visitor with no prior cache of the website’s content. AlertBot runs the tests inside real Firefox web browsers using AlertBot’s TrueBrowser™ monitoring. We calculate the speed as an overall average across all locations during the time span selected for this Showdown.

The speed for both websites were also relatively close to each other. VIVE.com’s best speed, on average, was seen on Monday, May 13 at 3.2 seconds, which isn’t bad. Their best time of day, however, was on Tuesday, May 21 at 5am with 1.6 seconds. It’s definitely better, although it’s doubtful that they usually see a high number of traffic on a given morning. VIVE.com’s worst averaged day was Thursday, May 23^rd at just 5.1 seconds. However, their worst time was on Wednesday, May 22nd at 2pm with a much less admirable 8.8 seconds. The site’s overall average speed across the entire test period was 3.78 seconds.  (VIVE.com 8/10)

Oculus.com performed very similarly. Their best day on average was Thursday, May 2^nd with 3.7 seconds. Their best response time was at 9am on Wednesday, May 15 with 2.05 seconds. Oculus.com’s worst averaged day was also (like VIVE’s) Thursday, May 23^rd at just 4.37 seconds (although that’s slightly better than VIVE’s worst). However, their worst time of day was on Wednesday, May 1^st at 6am with 7.49 seconds (making their slowest time a full second faster than VIVE’s slowest). The site’s overall average speed across the entire test period was 3.96 seconds (Just a smidge slower than VIVE’s).     (Oculus.com 8/10)

Geographic

It’s always interesting to see how sites perform differently across the world. If we look exclusively at the United States, it’s intriguing to see which states regularly see faster or slower times than others. For this portion of the test, we compare the overall average speeds of each individual location captured during the selected period of time for this Showdown.

Previously, California had reigned supreme as the fastest state in the U.S. But lately, other states have been stepping up, dethroning The Golden State. This time, North Carolina wins (for both sites), with VIVE.com moving at a breezy 1.69 seconds in The Old North State. Oregon came in second at 1.8 seconds, with Arizona at 2 seconds. Comparatively, Washington state saw the slowest speed, coming in at a shameful 10.9 seconds, with Washington DC in second at 7.55 seconds and Texas in third at 7.43 seconds. (VIVE.com 8/10)

Oculus.com was also under two seconds with 1.9 seconds in North Carolina. Their second fastest was 2.2 seconds in Nevada and 2.3 seconds in Oregon. Overall, they were pretty close to VIVE. However, while Oculus saw a better overall “slowest” location, the second and third slowest were a little worse. Washington, DC came in at 8.66 seconds, then Washington state at 8.65 seconds, and Texas at 8.55 seconds. For the most part, though, the sites performed rather closely.  (Oculus.com 8/10)

Usability

For evaluating a site’s usability, we always select a common task a user might typically try to accomplish when visiting the sites and replicate it. For our previous Showdowns, we tested things like going through the motions of ordering movie tickets from a local theater or simply adding a similar item to both sites’ shopping carts. For this Showdown, we’ll see what the experience is like to use their respective websites to see if we can order their latest VR headset.

For each of these processes, we started by opening a new tab in Google Chrome and typing in the site’s URL.

From the point of typing www.VIVE.com into our Chrome browser, it took 1 minute and 36 seconds (and a wealth of clicks) to come to the conclusion that you cannot order anything from their website (at least not easily, even though there’s a shopping cart icon on their menu bar), and that viewing a map to “Try VIVE Today” tells us that we have to live in Livingston, UK if we want to visit a store.

For www.Oculus.com, it took 3 clicks and 16 seconds to add the Oculus Quest 64 GB headset to our cart and be ready to checkout.

For these tests, we attempt to go into them without much prior knowledge of the site’s user side functionality to give it an unbiased test, so we’re pretty surprised at how drastically different the user experience was here. To give VIVE a fighting chance – even before trying Oculus’s site – we tried choosing a different headset in the event that maybe the most recent one isn’t available yet, and it still didn’t help. Perhaps the problem is that we’re performing the test from the US and VIVE’s parent company, HTC, appears to be UK-based. After further investigation, however, it appears that the only way to get to a purchasing option on VIVE’s site is to look at the “comparison” portion of the products page. Still, it seems odd that they wouldn’t make it easier and clearer to order their products. (Also, it appears that the webpage ends when you’re scrolling through, but it merely eventually changes the panel you’re “stopped” on as you scroll down, and then it moves you down the page to the next panel before stopping you again. It’s a neat design, perhaps, but no doubt a little confusing at first.)

With that in mind, here are the Usability scores:

(VIVE.com 5.5/10)
(Oculus.com 9/10)

Verdict

Both sites performed respectably, but when it comes to usability and speed, one unexpectedly outperformed the other—especially when it came to usability. So, we’re pleased to announce this Showdown champion to be…

Winner:

If there’s one snack shop you’re likely to find on any given street corner in your city, there’s a good chance it’s either a Dunkin Donuts or a Starbucks (and in some cases, they’re on either sides of the street from each other). Both chains serve up steaming hot caffeinated goodness – at varying affordability in pricing – as well as other sweet treats. And while different areas of the globe may have more common chains than these two, we East Coast natives have regular access to the fresh beans of these common coffee connoisseurs.

It’s no secret that those who rely on a warm, fresh cup of java to get their day started also know these bean beverages affect their daily performance. So we wanted to pose the question – what about the web performance of these respective coffee shops?

To test their website performance, we used AlertBot’s external website monitoring system and its TrueBrowser™ technology to monitor both DunkinDonuts.com and Starbucks.com from December 1^st through Christmas Day, 2018. Given the notoriety of both establishments, we expected their performance to be as strong as their brews, and we weren’t disappointed.

Reliability

For the reliability evaluation of a website, we look for failure events (like when a page doesn’t fully load or it is completely down), and we look for what caused those failures.

Both Dunkin Donuts and Starbucks’ sites performed quite well. Neither saw significant downtime, but each one experienced some sluggish speeds and even load time timeouts on a couple rare occasions.

DunkinDonuts.com experienced 99.96% uptime, with just a few errors recorded due to slow load times. None of these events lasted longer than a couple minutes, and none amounted to any significant downtime. Because of this, we still consider their performance to be quite solid.  (DunkinDonuts.com 8.5/10)

Starbucks.com performed similarly with 99.87% uptime and similar slow page load errors that didn’t amount to significant downtime but at least put a wrinkle in their performance. They experienced four times as many of these errors as Dunkin, so we have to take that into consideration with our rating. (Starbucks.com 8/10)

Speed

When evaluating a website’s speed, we look at the time it takes the site’s homepage to render and load to the point of being fully interactive by the user. These tests are performed from the perspective of a first-time visitor with no prior cache of the website’s content. AlertBot runs the tests inside real Firefox web browsers using AlertBot’s TrueBrowser™ monitoring.

The speed for both sites were relatively close to each other. DunkinDonuts.com’s best speed, on average, was seen on Sunday, Dec. 2 at 4.8 seconds, which isn’t stellar by any means, but not the worst either. Their best time of day, however, was on Wednesday, Dec. 19^th at 4am with 2.1 seconds. It’s considerably better, but 4am isn’t exactly prime web traffic time. Dunkin’s worst averaged day was Monday, Dec. 17^th at 6.2 seconds. However, their worst time was on Saturday Dec. 22 at 9am with a crawling 10.5 seconds. The site’s overall average speed across the entire test period was 5.6 seconds.  (DunkinDonuts.com 7.5/10)

Starbucks.com didn’t fare too much better in comparison. Their best day on average was Saturday, Dec. 1^st with 5.2 seconds. Their best response time was at 7am on Monday, Dec. 17 with 2 seconds. (It’s interesting that their best average time was on Dunkin’s worst averaged day.) Starbucks’ worst day on average was the previous day, Dec. 16, with 6.9 seconds, with their worst response time on average being at 9pm on Friday, Dec. 7^th with a slightly-slower-than-Dunkin’s-speed of 10.7 seconds. But, as you can see, both sites performed pretty close to one another. Starbucks.com’s overall average speed during the entire test period was a tad slower, at 6.3 seconds.   (Starbucks.com 7/10)

Geographic

It’s always interesting to see how sites perform differently across the world. If we look exclusively at the United States, it’s intriguing to see which states regularly see faster or slower times than others.

If you’ve been following these competitions at all, you’ll know that no one beats California in website load time speed. However, lately, we’ve been seeing more variety when it comes to which state in the U.S. has the faster speeds. This time around, Nevada wins (for both sites), with DunkinDonuts.com moving at a swift 1.79 seconds in The Silver State. Oregon came in second at 1.8 seconds, with Ohio at 2 seconds. Comparatively, Washington state saw the slowest speed, coming in at 10.8 seconds, with Colorado in second at 9.2 seconds and Texas in third at 9.1 seconds. (DunkinDonuts.com 8/10)

Starbucks.com loaded at 1.4 seconds in Nevada, which was faster than Dunkin’s best time. Their second fastest was 1.5 seconds in Oregon and 1.7 seconds in Ohio – all better than Dunkin’s best (1.79 seconds). However, Starbucks saw significantly slower load times than Dunkin, with all of their slowest load times being worse than Dunkin’s slowest. Washington came in at 12.5 seconds, then Colorado at 11.6 seconds, and Texas at 11.4 seconds. While they were a little faster than DunkinDonuts.com, they were also considerably slower, which is unfortunate.  (Starbucks.com 7.5/10)

Usability

For evaluating a site’s usability, we always select a common task a user might typically try to accomplish when visiting the sites and replicate it. For our previous Showdowns, we tested things like going through the motions of ordering movie tickets from a local theater or simply adding a similar item to both sites’ shopping carts. For this Showdown, we’ll see what the experience is like to use their respective websites to find their rewards program and get ready to sign up for it. (And we’re writing about it as we’re performing the test.)

For each of these processes, we started by opening a new tab in Google Chrome and typing in the site’s URL.

From the point of typing www.DunkinDonuts.com into our Chrome browser, it took 15 seconds and 1 click to find the signup page for their rewards program. (OK, maybe this is too easy?)

For www.Starbucks.com, it took one click and 10 seconds to get to the rewards signup page.

For these tests, we attempt to go into them without much prior knowledge of the site’s user side functionality to give it an unbiased test, but this one probably calls for a retest with a different approach.

Let’s try navigating their respective menus and trying to find out about their coffee items.

With this in mind, from the point of typing in DunkinDonuts.com and navigating through their menu to their coffee options, it took 4 clicks and 23 seconds to get to the page with their regular drip coffee and its nutrition info. It’s a nice website and an enjoyable one to navigate.

With the same goal in mind, for Starbucks.com, it took 5 clicks and over 35 seconds to find the brewed coffee, but the confusing menu setup made it tough to find just plain, hot drip coffee. The Dunkin menu has images for all their options, but Starbucks drops most of the images once you get to the menu, so we ended up on the cold brew menu instead. (As it turns out, it was the fifth option, “Freshly Brewed Coffee” that we actually were looking for… you’d think it’d be one of the first options, though… right?)

Given that the first test was inconclusive, the second one was a clear one for us (albeit unexpected). DunkinDonuts.com was quicker and easier to navigate, and much more user friendly.

With that in mind, here are the Usability scores:

(DunkinDonuts.com 9.5/10)
(Starbucks.com 8/10)

Verdict

Both sites performed respectably, but when it comes to usability and speed, one unexpectedly outperformed the other—even if just by a little bit. So, we’re pleased to announce this Showdown champion to be…

Winner:

While we’re still recovering from full bellies and empty wallets from the Thanksgiving celebratory weekend, we poured over the performance results for each site to drill in to see how they compared to last year’s event.

As usual, we used AlertBot’s external website monitoring system and its TrueBrowser™ technology to monitor all three sites from Thanksgiving Day through Black Friday and Cyber Monday, spanning from November 22, 2018 to November 26, 2018. We expected strong, reliable performance again during the entire run and we were not disappointed. The results were nothing short of impressive. In fact, we were impressed to mostly see improvement this year over last year.

Reliability

For the reliability evaluation of a website, we look for failure events (like when a page doesn’t fully load or it is completely down), and we look for what caused those failures.

Last year, in an unusual feat, each site experienced not a single error or failure event. The same mostly held true for 2018, but both Walmart.com and Target.com struggled with a few slow file load times (which can cause a page to load slower), but it was never enough to cause any actual site downtime. With that in mind, we think it’s still fine to award 10’s across the board.

(Amazon 10/10)
(Walmart 10/10)
(Target 10/10)

Speed

When evaluating a website’s speed, we look at the time it takes the site’s homepage to render and load to the point of being fully interactive by the user. These tests are performed from the perspective of a first-time visitor with no prior cache of the website’s content. AlertBot runs the tests inside real Firefox web browsers using AlertBot’s TrueBrowser ™ monitoring.

Last year was the first time we ran this event, so it was interesting to be able to compare last year’s results with this year’s. Ecommerce sites tend to have very graphics-heavy designs, and especially with sale events like these, the graphics are often big, frequently changing, and sometimes even animated or video-driven. (Amazon even had live video streaming at one point throughout the purchasing frenzy!)

With that said, through Amazon.com’s 5-day run, they saw the fastest day, on average, to be Sunday, November 25^th with 4.2 seconds—which is almost exactly what last year was (Their fastest was also a Sunday at 4.3 seconds). Their slowest day, on average, was actually on Black Friday itself at 4.5 seconds, which, admittedly, still isn’t too bad. When looking at specific times of day for performance, the best hour was 7AM on Sunday with an impressive 2.6 seconds (an improvement over last year by almost a full second), while the day before saw the slowest hour at noon with a dismal 9.3 seconds (which was significantly worse than last year).
(Amazon 9/10)

Walmart.com was the fastest last year and proved not only to hold that title again this year, but they also showed improvement! Their best average day was Cyber Monday, November 26th at 3.8 seconds. Their worst day on average was Sunday, November 25^th,  at 4.1 seconds (Coincidentally, it was also Nov. 25^th last year, but this year it was almost a full second faster). Finally, their best hour on average was on Cyber Monday at an impressive 1.8 seconds at 6PM. Their worst time on average was 6.9 seconds at 5PM on Black Friday, which is not when you want to be experiencing your slowest web speed.
(Walmart 9.5/10)

Last, but certainly not least, Target.com performed respectably, but once again underperformed in comparison to the other two. Their best day for speed, on average, was Black Friday at 5.4 seconds, which is not only worse than both Amazon and Walmart’s worst days, but it’s .2 seconds slower than their performance last year. Target’s slowest day on average was Cyber Monday, November 26 at 6.3 seconds, almost a full second slower than last year. Their fastest hour turned out to be on Black Friday at 5AM with 3.1 seconds, which is a slight improvement, with their slowest time being on Monday at 3PM with 8.9 seconds, over a second longer than last year, and sadly during mid-day on Cyber Monday.
(Target 8.5/10)

Geographic

It’s always interesting to see how sites perform differently across the world. If we look exclusively at the United States, it’s intriguing to see which states regularly see faster or slower times than others.

California has almost always come out on top as the fastest state, but this year they were consistently dethroned by none other than Oregon! For Amazon.com, the ecommerce mega-site saw average load times of 1.4 seconds in the The Beaver State, with their next-fastest location being Ohio at 1.6 seconds and Nevada at 1.8 seconds. When it came to their slowest locations, Washington, D.C. took the prize at a sluggish 7.5 seconds and Washington state clocking in at 7.3 seconds.
(Amazon 9/10)

Just like in 2017, Walmart.com was faster, but by a mere millisecond, seeing an average load time of 1.3 seconds in Oregon. Nevada and Ohio followed at Amazon’s fastest time, 1.4 seconds. Washington state saw the site’s slowest load time at 6.8 seconds, with Colorado coming in at 6.5 seconds and Texas at 6.3 seconds – all of them being faster than Amazon’s worst locations.
(Walmart 9.5/10)

Target actually saw some improvement this year with its average load time being fastest in Nevada at 2.3 seconds in (last year’s was 2.7 in California), while Oregon came in second at 2.5 seconds and Ohio third at 2.7 seconds. And like last year, Target’s fastest speeds proved to be slower than their competitors. The slowest average speed that Target saw in the U.S. was sadly worse than last year. Washington state clocked in at a truly dismal 10.7-second average load time, with Colorado a second behind at 9.6 seconds, and Texas at 9.3 seconds. It’s unfortunate that Target continues to miss the mark for website speed.
(Target 8.5/10)

Usability

For usability, we always select a common task a user might typically try to accomplish when visiting the sites we’re testing and replicate it. For last year’s Showdown, we decided to see what the experience would be like to use these three different websites to add a common product to the shopping cart. To do this, we selected one item to search for and add to our cart, and this year we decided to do the same again.

For each of these processes, we picked an easy item to search for, and sought to add a Blu-Ray copy of Disney and Pixar’s Incredibles 2 to our shopping cart. To begin each process, we started by opening a new tab in Google Chrome and typing in the site’s URL.

From the point of typing www.amazon.com into our Chrome browser, typing “Incredibles 2 blu-ray” into the store’s search box, and adding it to the cart, it took 34 seconds. From the front page, it took about 5 clicks (including having to log in to get to the final checkout) to get to the “Place your order” window.

From the point of typing www.walmart.com into Chrome and going through the same process, it took about 6 clicks and 32 seconds to log in and get to the final cart checkout page.

And from the point of typing www.target.com into our Chrome browser, it also took about 6 clicks and 32 seconds to log in and get to the checkout window.

Each site was a good experience to use, although each one has a different feel and approach. It’s a tough call to say which user experience we found to be better, but each one was straightforward and easy to use. If we judge the sites based on search results, Amazon tried suggesting a few things unrelated to the specific search of the “blu-ray” disc first (like a Jurassic Park daily deal and a preorder for Venom), while both Target and Walmart have more direct and accurate results (even though Walmart suggests the DVD and 4K before the actual blu-ray). In that case, we’d have to give Walmart and Target a little more props for accuracy in their product search.

(Amazon 9.5/10)
(Walmart 9.5/10)
(Target 10/10)

Verdict

With stakes this high once again, you would only expect the best from the leaders in ecommerce, so it comes as no surprise that the results were so good and so close.

With all things accounted for – reliability, speed, geographical performance, and the site’s usability – we’ve reached our verdict, and it surprises even us for a second year in a row:

Winner:

Even though our world continues to creep ever closer to being paper-free—trading our paper tablets for iPads, office supply stores have had to reinvent the way they do business and what their focus is. Staples and OfficeDepotTh are two mega-chain retailers who’ve long been in the fight, regularly providing printing services, as well as day-to-day necessities for the workplace, like pens, calendars, computer accessories, and so much more. And with the all-in-one ecommerce solutions monopolizing the public’s needs (we’re looking at you, Amazon), the desire to shop at these niche market leaders—who typically charge more for the same products—is becoming less and less.

So, for our latest, Showdown, we looked at these two office supply bigwigs and used AlertBot’s external website monitoring system and its TrueBrowser™ technology to monitor both sites for a couple weeks, spanning from August 26 to September 16, 2018. After engaging in this different kind of “Office Olympics,” we were expecting the usual quiet response from two reliable websites (i.e. good performance), but instead found what was equivalent to, well, a fun office chair race gone horribly wrong.

Reliability

For the reliability evaluation of a website, we look for failure events (like when a page doesn’t fully load or it is completely down), and we look for what caused those failures.

Both Staples and OfficeDepot’s sites seemed to perform satisfactorily, with neither site ever really seeing significant downtime, but one of them really seemed to struggle with its load time.

AlertBot ended up returning over 800 alerts from Staples.com in the evaluated time span, with half of them being slow files bogging down the page, and the other half being page load timeouts. This doesn’t necessarily mean the site crashes, just that it’s taking unusually long to load. Their site regularly had a pop-up window during this time period promoting signing up for their email list, which seemed to play a part in disrupting the site’s load time and process.  (Staples.com 5/10)

On the flip side, OfficeDepot.com performed much better (despite also having a pop-up on its page), but while it seemed to see problems less often, it did experience two failure events, experiencing 98% uptime (compared to Staples’ 100%). The majority of the errors OfficeDepot experienced were slow files or longer load times. Despite this, however, it seems as though its worst times were in the middle of the night (a frequent site maintenance time), which is common for most sites. (OfficeDepot.com 7/10)

Speed

When evaluating a website’s speed, we look at the time it takes the site’s homepage to render and load to the point of being fully interactive by the user. These tests are performed from the perspective of a first-time visitor with no prior cache of the website’s content. AlertBot runs the tests inside real Firefox web browsers using AlertBot’s TrueBrowser™ monitoring.

Staples.com’s speed tests proved that load times were a regular issue. Its best day, on average, was Monday, September 17^th with 7.9 seconds. It’s not the worst load time, but given that most sites are expected to load in 2 to 3 seconds these days, it’s almost three times that. Their best time of day was on Thursday, September 6 at 10am with 3.3 seconds. The worst day, on average, was Friday, September 7^th with 10.3 seconds, while the worst time of day was at 1am on Sunday, September 9^th with a sluggish 13.8 seconds.  (Staples.com 7/10)

OfficeDepot.com actually fared worse, comparatively. Their best day proved to be Thursday, September 6 with 9.9 seconds for the page to load. Their best time of day was at 6pm on Wednesday, September 5^th at 6.4 seconds. Their worst is significantly worse, with Monday, August 27^th seeing an average of 12.5 seconds, and the worst time of day being on the same day at 3am with 16.8 seconds! (OfficeDepot.com 6/10)

Geographic

It’s always interesting to see how sites perform differently across the world. If we look exclusively at the United States, it’s intriguing to see which states regularly see faster or slower times than others.

Typically, for the geographic tests, California is king, always turning in the fastest response time. For Staples, it’s actually North Carolina, who saw an average of 3.7 seconds of page load time. Washington, DC was second at 4.7 seconds, and New York was third at 5.2 seconds. The state with the slowest results was Missouri with 15.1 seconds and New Jersey with 15 seconds. Oddly enough, California, Florida, Colorado and Virginia all averaged 15 seconds—which is unusual. (Staples.com 6.5/10)

Things were the norm for OfficeDepot, however. They saw their fastest speeds in California, at 7.5 seconds, with Virginia being second fastest at 7.7 seconds. Their slowest performance was Missouri with a crawl of 19.9 seconds, and Utah followed it up at 15.6 seconds. (OfficeDepot.com 6/10)

These aren’t the worst website load times we’ve seen, but they also weren’t anything to brag about either.

Usability

For evaluating a site’s usability, we always select a common task a user might typically try to accomplish when visiting the sites and replicate it. For our previous Showdowns, we tested things like going through the motions of ordering movie tickets from a local theater or simply adding a similar item to both sites’ shopping carts. For this Showdown, we’ll see what the experience is like to use their respective websites to find an office executive chair and add it to our shopping cart.

For each of these processes, we started by opening a new tab in Google Chrome and typing in the site’s URL.

From the point of typing www.staples.com into our Chrome browser, it took 30 seconds and 5 clicks to search for “office executive chair,” click on one to view its product page, add it to the cart, and click “checkout.” (It had us thinking “That was easy!”)

For OfficeDepot.com, it took about 40 seconds and 6 clicks to get to the checkout process. OfficeDepot had a pop-up as soon as we got to the site which added one click, and then clicking on the cart and going to the checkout seemed to be a clunkier experience.

It’s a tough call for usability, but we did find the Staples checkout process to be a tad smoother.

All things considered, here are the Usability scores:

(Staples.com 9/10)
(OfficeDepot.com 8/10)

Verdict

It’s surprising how closely these two office supply giants performed – and how disappointing each did as well.  Still, neither were so bad that they experienced many full-on website failures, but both could benefit from some serious attention paid to increasing their website speed. Neither site really stands out above the other with its performance, because the good and the bad often balanced each other out, but when it comes down to considering the sheer usability as a tie breaker, we feel the verdict is…

We used AlertBot’s external website monitoring system and its TrueBrowser™ technology to monitor both sites for a couple weeks, spanning from July 1 to July 22, 2018. As both sites and services are continuing to grow and change (Heaven knows MoviePass will probably change their rules and operations again before you finish reading this sentence), we weren’t surprised to see how similar the sites for each service performed.

Reliability

For the reliability evaluation of a website, we look for failure events (like when a page doesn’t fully load or it is completely down), and we look for what caused those failures.

Both MoviePass and Sinemia performed well here, but one did seem to struggle a little more than the other.

MoviePass.com experienced a 98.2% average uptime due to several days where the site seemed to perform slower than usual, causing the pages to not load fully – even triggering a strange account lookup error on the front page for several hours on July 14^th. This resulted in 18 failure events cataloged by AlertBot, with an average failure time of 32 minutes. This doesn’t mean downtime, per say, but the details did show that the site was struggling with its speed and load times. (MoviePass.com 7/10)

Comparatively, Sinemia.com saw 99.98% uptime with 1 failure event, although it wasn’t anything that spelled major downtime. At worst, it appeared to be a slow page / busy error that didn’t last long enough to qualify as site downtime. Overall, Sinemia proved to be pretty reliable. (Sinemia.com 9/10)

Speed

When evaluating a website’s speed, we look at the time it takes the site’s homepage to render and load to the point of being fully interactive by the user. These tests are performed from the perspective of a first-time visitor with no prior cache of the website’s content. AlertBot runs the tests inside real Firefox web browsers using AlertBot’s TrueBrowser™ monitoring.

MoviePass.com saw acceptable page load speeds overall, with their best average day being Wednesday, July 4^th with 3.9 seconds. The best time of day was 1am on Friday, July 20^th (which isn’t a popular time to even be using a site like theirs) at an average of just 1.6 seconds. On the other side of the proverbial coin, the slowest day was Saturday, July 14 with an average time of 8.9 seconds, and the worst time of day was also on the same day at noon (yikes!) with an embarrassing 14.1 seconds.  (MoviePass.com 7.5/10)

Sinemia actually didn’t perform too much better, with their best average speed for a single day being Saturday, July 21 with 5.4 seconds and their best time of day being Wednesday, July 4^th at 5pm with 2.7 seconds. Their slowest day was Monday, July 23^rd with 7.3 seconds, with the slowest time being on July 2^nd at 10pm with 10.2 seconds. (Sinemia.com 8/10)

Geographic

It’s always interesting to see how sites perform differently across the world. If we look exclusively at the United States, it’s intriguing to see which states regularly see faster or slower times than others.

MoviePass.com performed the fastest in California with 1.8 seconds, with Florida coming in second at 2.4 seconds. The site performed slowest in Missouri with a sluggish 10.2 seconds, with Utah coming in second at 8.5 seconds. (MoviePass.com 8/10)

For Sinemia.com, California was also the fastest at 2.9 seconds, and Virginia was second fastest at 3.5 seconds. Missouri was also the slowest, at 11.3 seconds, with Utah being second slowest at 9.1 seconds. (Sinemia.com 7.5/10)

Neither site was all that impressive in the nature of speed – which is interesting considering there isn’t a whole lot of content on their websites to slow them down.

Usability

For usability, we select a common task a user might typically try to accomplish when visiting the sites and replicate it. For our previous Showdowns, we tested things like going through the motions of ordering movie tickets from a local theater or simply adding a similar item to both sites’ shopping carts. For this Showdown, we’ll see what the experience is like to use their respective websites to start the service signup process (but not complete any forms).

For each of these processes, we started by opening a new tab in Google Chrome and typing in the site’s URL.

From the point of typing www.moviepass.com into our Chrome browser, it took a mere 18 seconds and 2 clicks to see their plans and get to the signup form. It was a piece of cake.

For Sinemia.com, it was actually just as smooth. In 17 seconds and 2 clicks, we were able to select a plan and get to the signup page.

It’s a tough call for usability. They’re simple processes, but they get the job done and we have no complaints.

All things considered, here are the Usability scores:

(MoviePass.com 10/10)
(Sinemia.com 10/10)

Verdict

The usability usually isn’t this straightforward and clear for both sites, so it leaves us to look almost exclusively at the other categories to draw a conclusion.

Without assuming MoviePass may have more hiccups in speed due to a greater deal of traffic, Sinemia.com seems to be a clearer choice for reliability as a whole, but the sites are quite close. That bad day on July 14 also really hurt MoviePass’s performance during this evaluation period, but it can’t be ignored. So, with that said, we believe the verdict is…

Winner:

Whether it’s designing a centerpiece for home or an event, perusing the aisles for tools for a school project, or locating a frame for that beloved photograph, it’s likely you’ve found yourself inside an arts and crafts store at some point. From cloth patterns to drawing pencils to blank canvases and custom framing, these craft supply stores are just what creative people  look for in a retailer.

With the rise of ecommerce, arts and crafts stores are just as accessible from the comfort of your computer or mobile device. For artists and crafters, something is undoubtedly lost when shopping online for these kinds of supplies, but the ease of online shopping is undeniable. Two of the biggest players in the market are Michael’s and A.C. Moore, so for this, our ninth, Showdown, we’ve pit the web performance of these two leading crafty retailers against each other.

We used AlertBot’s external website monitoring system and its TrueBrowser™ technology to monitor both sites for a couple weeks, spanning from March 25, 2018 to April 8, 2018. As expected, both sites performed quite well, but as in most cases like this, one site saw better results than the other.

Reliability

For the reliability evaluation of a website, we look for failure events (like when a page doesn’t fully load or it is completely down), and we look for what caused those failures.

Both websites did really well here, with neither site seeing any significant, true downtime.

Michaels.com experienced 99.9% average uptime due to 2 page load timeout failure events (where something on the page takes a bit longer to load, slowing the page’s overall performance down). When drilling down to see what errors Michaels.com returned, it signaled 17 instances where the page took longer to load than expected, and 15 times where something on the page took too long to load and slowed the page down. Still, despite the 2 timeouts, Michaels did well overall. (Michaels.com 8.5/10)

Comparatively, ACMoore.com saw 100% uptime with no significant failure events. However, there were still 4 recorded moments where there was a slow file and 4 occurrences of when the page itself took longer to load than expected. Still, ACMoore.com never actually went down, so we have to give them high marks for that.
(ACMoore.com 9.5/10)

Speed

When evaluating a website’s speed, we look at the time it takes the site’s homepage to render and load to the point of being fully interactive by the user. These tests are performed from the perspective of a first-time visitor with no prior cache of the website’s content. AlertBot runs the tests inside real Firefox web browsers using AlertBot’s TrueBrowser ™ monitoring.

Michaels.com saw pretty decent page load speeds overall, with their best average day being Wednesday, April 4^th with 3.5 seconds. The best time of day was 6pm on Friday, April 6^th at an average of just 2.1 seconds. On the flip side, the slowest day was Sunday, March 25 with an average time of 6.8 seconds, and the worst time of day was Sunday, April 8 at 8pm with 6.7 seconds.  (Michaels.com 8.5/10)

ACMoore.com was truly impressive with their load time. Their best day—Tuesday, March 27 with an average of just 1.5 seconds! A.C. Moore’s best time was even faster with Wednesday, April 4^th, at 10pm seeing a load time of just 1.2 seconds. Even more amazing was the fact that ACMoore.com’s worst day—Thursday, March 29–saw an average load time of 1.8 seconds! Their worst time, however, was significantly longer (in comparison) at 3.8 seconds on Thursday, April 5 at 3pm. (It’s interesting that both slower speeds were on a Thursday.) It was really a rarity that ACMoore.com went over 2 seconds in load time, and for that, we have to applaud their excellent web performance. (ACMoore.com 10/10)

Geographic

It’s always interesting to see how sites perform differently across the world. If we look exclusively at the United States, it’s intriguing to see which states regularly see faster or slower times than others.

California continues to reign supreme as the leading location in speed. Michaels.com loaded within 2 seconds (on average) in California, with Florida seeing the second fastest speed of 2.5 seconds. Missouri turned out to have the slowest load time of 7.1 seconds, while Utah came in second-to-last at 4.9 seconds. (Michaels.com 8.5/10)

For ACMoore.com, California is the fastest, once again, at an average of just 1.9 seconds. The second fastest, again, is Florida with 2.4 seconds. The slowest speed time is also seen in Missouri at an average of 8.2 seconds, with NJ coming in second-to-last at 5.5 seconds. It’s interesting to note that ACMoore.com proved to have faster speeds than Michaels, but also slower speeds (when it comes to loading in specific locations). (ACMoore.com 8.5/10)

Usability

For usability, we select a common task a user might typically try to accomplish when visiting the sites and replicate it. For our previous Showdowns, we tested things like going through the motions of ordering movie tickets from a local theater or simply adding a similar item to both sites’ shopping carts. For this Showdown, we’ll see what the experience is like to use their respective websites to find some paint brushes, add them to the shopping cart and start the checkout process.

For each of these processes, we started by opening a new tab in Mozilla Firefox and typing in the site’s URL.

From the point of typing www.michaels.com into our Firefox browser and searching “paintbrushes” in the product search box, it took 30 seconds and 4 clicks to select a pack of brushes, add them to the cart and view the cart.  It was definitely a smooth experience.

ACMoore.com was, unfortunately, a far more frustrating experience. Upon visiting the site, we were hit with a pop-up asking for us to signup for their email list to get a coupon. Plus, their signup box at the top of the page is typically where a site search would go, so it’s easy to mix them up (despite the “Sign Up for Offers” label next to it). It didn’t take long to discover that their site also doesn’t seem to specialize in craft materials, as a search for something as basic as “paintbrushes” returned nothing. We tried altering the wording in our search a bit but gave up after reaching a minute and a half.

To be fair, we decided to run the usability process again with different search criteria. ACMoore.com seems organized by craft project ideas, without any real discernable things you can purchase from their site (and yet, they have a shopping cart), which makes the sites quite different from each other (and gives Michaels.com an edge over ACMoore.com in sheer product availability and variety). In the end, while the brick and mortar stores are very similar, their online presences are not. So we decided to run it again to see how fast we can get to, and briefly look around, their individual Weekly Ads.

For Michaels.com, it took about 2 clicks and roughly 10 seconds to get to the Weekly Ad for May 6 and start clicking around. It offered two choices for ads, but we chose the basic ad for the week to browse. It was a very easy experience.

For ACMoore.com, it took 20 seconds, 3 clicks and typing in our zip code to get to our local area A.C. Moore store’s ad before we could start clicking around. The ad isn’t nearly as thorough or as nice as Michael’s is, either.

All things considered, here are the Usability scores:

(Michaels.com 10/10)
(ACMoore.com 3/10)

Verdict

When it comes to speed, ACMoore.com bested their competitor, Michaels.com, but given the lack of substance and actual storefront of ACMoore.com, it may not be too fair to compare them. However, a quick lap through the aisles of both brick-and-mortar stores for each brand will show just how similar each store is. So, with taking everything into consideration, and both sites performing very well when it comes to the actual site reliability, it’s hard not to give weight to the user experience when making the final conclusion…

It may have been squashing a goomba while punching a coin out of a brick, dodging barrels being thrown by a grumpy gorilla, sorting oddly shaped falling blocks into interlocking patterns or simply catapulting miffed fowl at a group of defenseless pigs on your mobile phone, but chances are high that everyone has played a video game at one point in their life.

Poor web performance is no game any self-respecting owner of a website should play. We recently aimed our sights at the gaming industry and picked out two heavy hitters to evaluate: Xbox and Playstation. While their websites may not be the main point of interest for gamers, they’re relied upon for information, updates and even online digital game sales. Their online gaming servers may be the most important thing to keep running smoothly in gamers’ minds, but these top players in the industry will want to make sure their website stays up and always accessible.

We used AlertBot’s external website monitoring system and its TrueBrowser™ technology to monitor both sites for a couple weeks, spanning from February 4, 2018 to February 25, 2018. Both sites performed well—as can be expected from parent companies Microsoft (Xbox) and Sony (PlayStation)—but, as usual, one performed just slightly ahead of the other, even if not by much.

Reliability

For the reliability evaluation of a website, we look for failure events (like when a page doesn’t fully load or it is completely down), and we look for what caused those failures.

Both websites experienced 100% uptime, but both sites encountered minor errors that served as a few speedbumps along the way. Still, it wasn’t enough to qualify as downtime.

Xbox.com, despite its 100% uptime, experienced around 50 “slow page” warnings and over 20 page load timeouts (where something on the page takes a bit longer to load, slowing the page’s overall performance down). Xbox.com also returned an SSL Certificate expiration notice. However, none of these qualified as significant outages, and for that we still have to give them props. (Xbox 9/10)

Playstation fared the same with 100% uptime and a lot better when it came to the little errors. They only registered 7 timeouts and 5 slow page loads, and for that we give them slightly higher marks.  (Playstation 9.5/10)

Speed

When evaluating a website’s speed, we look at the time it takes the site’s homepage to render and load to the point of being fully interactive by the user. These tests are performed from the perspective of a first-time visitor with no prior cache of the website’s content. AlertBot runs the tests inside real Firefox web browsers using AlertBot’s TrueBrowser ™ monitoring.

Speed is crucial to the gamer – be it game load times (who else hates waiting for spinning icons to finish to get us past a cut scene or moving on to a new map in a game?) or server responsiveness – so a speedy game company website is key. Xbox.com experienced pretty quick load times, with its best day being February 24^th with an average of 4.6 seconds. Its best response time, however, was on February 23^rd at noon with 2.2 seconds. On the flipside, its worst day was February 12 with 6.7 seconds (which isn’t all that bad), but their worst hour proved to be on February 11^th at 11pm with a sluggish 13.1 seconds. (Xbox 8.5/10)

Surprisingly, Playstation turned out to be just a little bit slower, with their best day average being 6 seconds on February 22^nd. Their best time by the hour was on the same day at noon with 2.3 seconds, just a hair slower than Xbox’s best time. Their worst day was a full second longer on February 11^th with 11.7 seconds, and their worst time by the hour was also 13.1 seconds, but on February 10^th at 7am. (Playstation 8/10)

Geographic

It’s always interesting to see how sites perform differently across the world. If we look exclusively at the United States, it’s intriguing to see which states regularly see faster or slower times than others.

California seems to win out most of the time as the fastest location for load times and for Xbox.com, it was no different. California saw load speeds of 2.1 seconds on average, with Florida coming in second at 2.2 seconds. Georgia, however, saw an average worst time of 10.3 seconds with Missouri coming in second at 9.2 seconds. (Xbox 8.5/10)

Playstation.com actually turned in slightly more sluggish results geographically, too. Their best location was California, as well, but it was 2.5 seconds, and Florida was a close second at 2.7 seconds. Playstation’s slowest spots were also in Georgia and Missouri, at 12.6 seconds and 11.2 seconds, respectively. It’s not the worst we’ve seen, but Xbox clearly performed better. (Playstation 7.5/10)

Usability

For usability, we select a common task a user might typically try to accomplish when visiting the sites and replicate it. For our previous Showdowns, we tested things like going through the motions of ordering movie tickets from a local theater or simply adding a similar item to both sites’ shopping carts. For this Showdown, we’ll see what the experience is like to use their respective websites to add a digital download of a popular video game to the shopping cart and start the checkout process.

For each of these processes, we started by opening a new tab in Google Chrome and typing in the site’s URL.

From the point of typing www.xbox.com into our Chrome browser and clicking around to find the Xbox One games, choosing the featured one (which, in this case was Dragonball FighterZ), clicking “Buy Now” and getting to the account login screen, it took 1 minute and 10 seconds. From the homepage, it took 7 clicks to get to the checkout process. It’s been a while since we’ve last visited their site, so our experience was fresh, but we encountered some significant slow loading times when getting to the product page. We actually added an additional click to the process because the “Buy Now” button didn’t load properly at first (and did nothing upon its first click). Overall, we got to do what we set out to do, but the process could have gone a lot smoother.

We were hoping for a better experience from Playstation, and we got one. From the point of typing www.playstation.com into our Chrome browser, it took 4 mouse clicks and 35 seconds to find a featured video game (in this case, Bravo Team), and get to the checkout stage (which was also an account login screen). There was some delay on first clicking on the game title, but it still loaded quickly and allowed us to get to the end of the process fast.

Both sites allowed us to get the job done in a rather speedy manner, but Playstation’s site gave us a much more positive experience.

With that said, here are the Usability scores:

(Xbox 8/10)          (Playstation 9.5/10)

Verdict

Both sites performed very well, but that positive user experience helped push one over the other, albeit only slightly. So while it was a tough call to make, we have come to a conclusion —

Whether you’re hitting the gym or the trails, you’re likely to be lacing up with some active footwear that helps you burn calories and exercise in comfort and style. When it comes to activewear, there are many companies these days who contribute their accessories and gear to our daily workout regiments, however, two major players come to the front of our minds when it comes to popular footwear brands.

For our latest AlertBot Showdown, we picked frontrunners Nike and Reebok to evaluate the website performance for each athletic wear’s online persona.

We used AlertBot’s external website monitoring system and its TrueBrowser™ technology to monitor both sites for a couple weeks, spanning from October 1, 2017 to October 22, 2017. While both sporty sites performed well, it became pretty clear after a significant trip-up that one site left the other in the dust.

Reliability

For the reliability evaluation of a website, we look for failure events (like when a page doesn’t fully load or it is completely down), and we look for what caused those failures.

For the first time in our experience of tracking sites for a Showdown, one of the sites in the running went down while we were actually in the office. That gave us the ability to watch the event as it unfolded while AlertBot performed its tests against the failing site. Reebok.com hit a snag on October 13 around 3:30pm EST. It took nearly a full hour for their site to recover. We manually checked their site from our desks at 4pm, and the site was still down. We checked again at 4:15 and the site was back up, however, only text was loading – no images. By 4:30pm, when we checked one more time, the Reebok.com was back up in its entirety. It was the only failure event that Reebok.com encountered during the weeks it was tested for this Showdown, but it was definitely a doozy. During this time period, their average downtime was just 99.85%, but it’s proof that “99% uptime” can still contain an hour of critical downtime. And for a retail site, this could truly prove costly. (Reebok 7/10)

On the other hand, Nike.com experienced no significant failure events and only occasionally experienced minor issues like a slow page file or a “timed out” error. From the starting line, Nike is already on the fast track to success between the two brands. (Nike 9.5/10)

Speed

When evaluating a website’s speed, we look at the time it takes the site’s homepage to render and load to the point of being fully interactive by the user. These tests are performed from the perspective of a first-time visitor with no prior cache of the website’s content. AlertBot runs the tests inside real Firefox web browsers using AlertBot’s TrueBrowser ™ monitoring.

Speed is everything for the image of brands like these, which makes it a bit ironic that both sites seem to struggle a little in this area. Reebok’s fastest average speed was on October 4^th with 6.4 seconds load time. Their worst average speed was October 23 at 7.9 seconds. They’re not drastically different, but that’s not an impressive load time.  (Reebok 7/10)

At this point, one might expect Nike to sprint past Reebok in the load time category, but Nike didn’t fair much better, with 6.3 seconds being their fastest average speed on October 23 (which is coincidentally the day of Reebok’s slowest average), and Nike’s slowest average speed was 7.5 seconds. Again, they’re not great speeds, but in this case, Nike edges out Reebok, even if it is only by a slight skip rather than a jump. (Nike 7/10)

Geographic

It’s always interesting to see how sites perform differently across the world. If we look exclusively at the United States, it’s intriguing to see which states regularly see faster or slower times than others.

Looking at site response time geographically tells a different story. First off, Reebok shows that they had the fastest load time in Texas with an average of 3.7 seconds. Their second fastest time was in New Jersey at 4.8 seconds. Virginia produced the slowest return, with an average of 6.9 seconds. (Reebok 7.5/10)

Yet again, Nike only performed slightly better, with California showing the fastest average speed of 3.2 seconds and Texas showing the second fastest at 4.5 seconds. However, Nike performed worse than Reebok when it came to slowest location, with Illinois taking the cake for worst average speed, at 9.7 seconds! (Nike 7/10)

Usability

For usability, we select a common task a user might typically try to accomplish when visiting the sites and replicate it. For our previous Showdowns, we tested things like visiting a site for nutritional information or going through the motions of ordering movie tickets from a local theater, or simply adding a similar item to both sites’ shopping carts. For this Showdown, we’ll see what the experience is like to use their respective websites to add their latest running shoe to the shopping cart and start the checkout process.

For each of these processes, we started by opening a new tab in Google Chrome and typing in the site’s URL.

From the point of typing www.reebok.com into our Chrome browser and clicking around to find a Men’s Running Shoe, choosing the first one, choosing a size, adding it to the cart and clicking “checkout,” it took 36 seconds. From the homepage, it took 5 clicks to get to the checkout process. At first glance at the homepage of the site, it seemed like it might be a challenge to actually find what we’re looking for, but it was a pretty easy shopping experience.

From the point of typing www.nike.com into our Chrome browser, it took 8 mouse clicks and 48 seconds to find a men’s running shoe and get to the checkout stage. Upon first visiting the site, the visitor is hit with an ultra closeup of a bunch of kids in gray Nike hoodies and it takes most of the page hostage. We scrolled down to the first running shoe advertised and clicked on it, only to find that it was only a women’s shoe (which is not mentioned on the image on the homepage). We then had to click around to the men’s department, for this task’s purpose, in order to find a shoe and continue the process. Both sites get the job done, but Reebok was a more pleasant shopping experience.

With that said, here are the Usability scores:

(Reebok 9/10)        (Nike 8/10)

Verdict

Both sites performed respectably, but we can’t ignore that failure that Reebok experienced on the 13^th. Other than that, the sites performed quite similarly (and we actually preferred Reebok’s shopping experience a little more than Nike’s). Still, since we’re really weighing in here on web performance, the winner is rather clear —

It’s that time of year again, where sales conscious bargain chasers brave the throngs of other sale hunters in the frigid November early morning air on that most dreaded of retail shopping days: BLACK FRIDAY. Just hours earlier, many of these same credit-card-wielding warriors were huddled around a table with family, giving thanks once again while stuffing themselves to their waistline’s discontent with mashed potatoes, roasted turkey and homemade pie. The juxtaposition of these two contradicting practices is staggering, but it’s no less the holiday tradition year after year.

As we approach another Christmas holiday, the world of ecommerce continues to ramp up the way they approach Black Friday–and its younger electronic sibling, Cyber Monday–with many now starting their sales right after Halloween. Accordingly, we decided to do something special for our next Website Showdown: a Black Friday / Cyber Monday edition that pits the ecommerce colossus Amazon against the websites for brick-and-mortar retail mega-stores Walmart and Target. It’s a truly epic battle royale to see how each site performs during the biggest shopping days of the year.

So, as usual, we used AlertBot’s external website monitoring system and its TrueBrowser™ technology to monitor all three sites from Thanksgiving through Black Friday and Cyber Monday, spanning from November 23, 2017 to November 27, 2017. We expected strong, reliable performance during the entire run and we were not disappointed. The results were nothing short of impressive.

Reliability

For the reliability evaluation of a website, we look for failure events (like when a page doesn’t fully load or it is completely down), and we look for what caused those failures.

Usually for this section, we evaluate each site’s performance in detail, drilling down to specific errors each one faced, and the different types of errors we usually see (like Slow Page Files, Timeouts, etc). It’s unusual for the sites in a two-site Showdown to not return a single error, much less a three-site Showdown. In this special evaluation of three sites, not one single, solitary error was found between them. All three sites avoided any kind of failure event or significant error. With the stakes so high for three of the biggest retailers on the most significant sale days of the year, one would expect nothing less. So, with that said, each site earns a perfect score for Reliability.

(Amazon 10/10)
(Walmart 10/10)
(Target 10/10)

Speed

When evaluating a website’s speed, we look at the time it takes the site’s homepage to render and load to the point of being fully interactive by the user. These tests are performed from the perspective of a first-time visitor with no prior cache of the website’s content. AlertBot runs the tests inside real Firefox web browsers using AlertBot’s TrueBrowser ™ monitoring.

Sites like Amazon, Walmart and Target boast very graphics-driven designs, and especially with monstrous sale event days like these, the graphics are often big, bold, and frequently changing.

With that said, of Amazon.com’s 5-day run, they saw the fastest day, on average, to be Sunday, November 26^th with 4.3 seconds. It’s not the slickest speed a site can have, but it’s certainly not bad. On their slowest day, on average, Amazon still clocked in at 5 seconds on Cyber Monday, which is still not too shabby. When looking at specific times of day for performance, the best hour was at 5AM on Sunday with an impressive 3.4 seconds, while Cyber Monday also saw the slowest hour at 7AM with 6.7 seconds.
(Amazon 9/10)

Walmart.com held their own surprisingly well during this time, too. Their best average day was Thanksgiving Day, November 23^rd at 4.2 seconds, just barely edging ahead of Amazon. Their worst day on average was Saturday, November 25^th, also at 5 seconds. Finally, their best hour on average was on Thanksgiving at a remarkable 2.7 seconds at 5PM. Their worst time on average was 6.4 seconds at 2AM on Sunday, November 26.
(Walmart 9.5/10)

Last, but certainly not least, Target.com didn’t perform quite as well as the other two, but they still performed respectably, especially considering the fact their site avoided any failure events. Their best day for speed, on average, was Thanksgiving Day at 5.2 seconds, which is worse than both Amazon and Walmart’s worst days. Target’s slowest day on average was Sunday, November 26 at 5.4 seconds, which at the very least, shows a great consistency for the performance of the retail chain’s online presence. Their fastest hour turned out to be on Black Friday at 9AM with 3.9 seconds, with their slowest being on Cyber Monday at 4AM with 7.6 seconds.
(Target 8.5/10)

Geographic

It’s always interesting to see how sites perform differently across the world. If we look exclusively at the United States, it’s intriguing to see which states regularly see faster or slower times than others.

California tends to prove to see the fastest web transaction speeds in the country, and in this test scenario, they once again come out on top for each website. For Amazon.com, the titan of ecommerce saw average load times of 2 seconds in the The Golden State, with their next-fastest location being Texas at 3.2 seconds. When it came to their slowest locations, Illinois came in at the bottom with 6.6 seconds, with Georgia just above them with 6.3 seconds.
(Amazon 9/10)

Walmart.com was only a millisecond faster, seeing an average load time of 1.9 seconds in California, also coming in faster in Texas at 2.7 seconds. But Walmart saw a placement swap for which state was the slowest, with Georgia coming in at the bottom at 6.6 seconds and Illinois right above them at 6.5 seconds.
(Walmart 9.5/10)

Target loaded on average at 2.7 seconds in California, with Texas coming in next at 3.5 seconds. Again, Target’s fastest speeds proved to be slower than their competitors. The slowest average speed that Target saw in the U.S. was also Georgia, at 7.2 seconds, but Washington stepped in as their second slowest, at 7 seconds flat.
(Target 8.5/10)

Usability

For usability, we always select a common task a user might typically try to accomplish when visiting the sites we’re testing and replicate it. For our previous Showdowns, we tested things like visiting a site for nutritional information or going through the motions of ordering movie tickets from a local theater. Like with the most recent Showdown for Lowes and Home Depot, we decided to see what the experience would be like to use these three different websites to add a common product to the shopping cart.

For each of these processes, let’s see about adding the PS4 version of new video game Star Wars: Battlefront II to our shopping cart. To begin each process, we started by opening a new tab in Google Chrome and typing in the site’s URL.

From the point of typing www.amazon.com into our Chrome browser, typing “Star Wars Battlefront 2” into the store’s search box and adding it to the cart, it took 30 seconds. From the front page, it took about 5 clicks (including selecting the autocomplete suggestion in the search bar) to get to the final “Place Order” window.

From the point of typing www.walmart.com into our Chrome browser, it took about 4 clicks and 35 seconds to get to the Cart Checkout window. The autocomplete was a little clumsy to deal with (it was tough to tell if the browser was really proceeding to load the site), but overall, it was a decent experience.

From the point of typing www.target.com into our Chrome browser, it took about 5 clicks and 27 seconds to get to the Cart Checkout window.

All three sites were good experiences, although each one has a very different feel. It’s a tough call to say which user experience we found to be better, so we decided to try a second test. This time, we chose something different, like Wonder Woman on Blu-Ray. We also decided to try Mozilla Firefox this time.

The process of finding the Blu-Ray disc and getting to the checkout process on Amazon took about 4 clicks and 25 seconds. The process on Walmart.com took 26 seconds and 5 clicks. On Target.com, it took roughly 24 seconds and 4 clicks. This time, we noticed that in the search results, there’s a convenient “Add to cart” option next to the items on Target’s site that Walmart and Amazon both DON’T have. This definitely gives Target a slight edge over their competitors. And with that being the only real significant difference, outside of its slightly faster completion time, we’ll have to say Target wins the Usability portion of this Showdown.

(Amazon 9.5/10)
(Walmart 9.5/10)
(Target 10/10)

Verdict

With stakes this high, you would only expect the best from the leaders in the retail industry, so it comes as no surprise that the results were so good and so close. This may be the toughest Showdown we’ve had to score yet, especially with three hats in the ring this time around.

But, with all things accounted for – reliability, speed, geographical performance, and the site’s usability – we’ve reached our verdict:

WINNER:

Living in an age where nearly every industry is driven by ecommerce, it should come as no surprise that this includes the home improvement world. Home Depot and Lowes are titans in their industry, and both have a strong online presence. But when it comes to who may have the better performing site, we set out to nail down one true winner.

For our fifth website Showdown, the AlertBot team got out their proverbial measuring tape and slipped on a stylish apron to dig in to the performance of HomeDepot.com vs Lowes.com.

We used AlertBot’s external website monitoring system and its TrueBrowser™ technology to monitor both sites for a couple weeks, spanning from August 11, 2017 to August 31, 2017. Not surprisingly, the performance for these heavy lifters proved to be rather resilient for both sites. Neither service’s site experienced significant downtime, but as usual, one did prove to perform a little better the other.

Reliability

For the reliability evaluation of a website, we look for failure events (like when a page doesn’t fully load or it is completely down), and we look for what caused those failures.

HomeDepot.com performed quite well over the tested time period, experiencing no failure events. At most, it had a couple hiccups, like a short-lived Timed Out error or a Slow Page File notice, but none of these occurrences caused any amount of significant downtime. (HomeDepot 9/10)

On the other hand, Lowes’ site experienced one failure event on August 21^st when the site was not responding for roughly three minutes around 12:21 in the afternoon. When errors like these occur, AlertBot tests them from a second location to confirm if the error is widespread or just a brief localized outage. In this instance, the error persisted after a few tests in different locations, qualifying it for actual site downtime, before the issue resolved.    (Lowes 8/10)

Speed

When evaluating a website’s speed, we look at the time it takes the site’s homepage to render and load to the point of being fully interactive by the user. These tests are performed from the perspective of a first-time visitor with no prior cache of the website’s content. AlertBot runs the tests inside real Firefox web browsers using AlertBot’s TrueBrowser ™ monitoring.

HomeDepot.com has a great deal of graphics on the front page, which typically slows sites down considerably. However, it didn’t seem to slow this site down much. HomeDepot.com’s best day, on average, was Tuesday, August 29^th  with an impressive load time of 1.1 seconds. The “worst” day average was still an impressive 1.9 seconds.  When evaluating the site’s speed by hour, the site loaded in just 0.8 seconds at 1AM on Sunday August 20^th. The worst hour was also on August 20^th, at 2PM with 5.1 seconds. Overall, HomeDepot.com’s speed is quite good.  (HomeDepot 9.5/10)

Lowes.com has drastically less content on its front page, but it performed considerably slower than HomeDepot.com did. Sadly, Lowes best day was actually slower than HomeDepot’s worst, with an average of 6 seconds on Sunday, August 13^th. Lowes.com’s worst day was Monday, August 26^th with 7.1 seconds. That’s not horrendous, but with sites being expected to perform faster and faster these days, a respected retail giant like Lowes needs to up their speed game. On an hourly average basis, their best time was 11PM on Wednesday, August 23^rd with 7.1 seconds (Again, their fastest time is slower than HomeDepot’s slowest). Their worst load time by hour was Sunday, August 27^th at 1PM with a sluggish 10.1 seconds. (Lowes 8/10)

Geographic

It’s always interesting to see how sites perform differently across the world. If we look exclusively at the United States, it’s intriguing to see which states regularly see faster or slower times than others.

Usually when we look at site speeds across the United States, sites tend to perform better in California than anywhere else. This isn’t the case for HomeDepot.com, however. For Home Depot, Florida appeared to experience the fastest web transaction (less than one second), while it experienced the slowest transaction test in California (But it’s still only 2.3 seconds). After Florida, however, it experienced the next fastest web transactions in New Jersey and North Carolina (both at 1 second). (HomeDepot 9/10)

Lowes.com had the fastest web transaction in California at 3 seconds. The next fastest was North Carolina, already up to 4.3 seconds. The slowest performance occurred in New York at a whopping 9.4 seconds (with the second-slowest being Georgia with 9.3 seconds). (Lowes 7.5/10)

Usability

For usability, we select a common task a user might typically try to accomplish when visiting the sites and replicate it. For our previous Showdowns, we tested things like visiting a site for nutritional information or going through the motions of ordering movie tickets from a local theater. For this Showdown, we’ll see what the experience is like to use their respective websites to add a common product to the shopping cart.

For each of these processes, we started by opening a new tab in Google Chrome and typing in the site’s URL.

From the point of typing www.homedepot.com into our Chrome browser and entering “leather gloves” into the search box, choosing one and adding it to the cart, it took 25 seconds. From the front page, it took 5 clicks to get to the “Checkout now” process. It wasn’t bad, but we found the Lowes process just a bit smoother.

From the point of typing www.lowes.com into our Chrome browser, it took 4 mouse clicks and 20 seconds to get the gloves into the shopping cart and view the cart. The “Add to cart” button is much more obvious and visible on Lowes’ site, where it took a moment to locate it on Home Depot’s site. And while both sites offer a “compare” option so you can look at product features side by side, it wasn’t very noticeable on HomeDepot’s site, while it was more prominent on Lowes.com.

The aesthetic of both websites isn’t bad, but Lowes has a crisper and more streamlined appearance and functionality. Both sites get the job done pretty quickly, but we had a slightly smoother experience with Lowes. With that said, here are the Usability scores:

(HomeDepot 9/10)       (Lowes 10/10)

Final Verdict

Both sites performed respectably, but HomeDepot.com clearly performed faster and was more reliable than Lowes.com. Despite the fact that we may have preferred the shopping experience on Lowes.com just a little bit more, one cannot ignore the slower site performance.

So, for the fifth AlertBot Showdown, the site that gets to join the ranks of previous winners Apple, FedEx, and Burger King is…

WINNER:

Whether you’re picking up a Kids meal for your littlest picky eater or satisfying a hankering for greasy and salty French fries, chances are you’ve found yourself in line at a drive-thru for McDonald’s or Burger King at some point in your life. But these two massive burger chains also have an online presence, and while you’re not exactly going to try to order a single or double patty to be shipped to your home, you might find yourself visiting the websites for either fast food giant to look up their menus or latest promotions.

So for this, our fourth website Showdown, the AlertBot team rolled up their sleeves, grabbed a handful of ketchup packets, and sat down to take the wax paper wrap off of these two websites to see just how the sites for BK and Mickey D’s performed in comparison to one another.

We used AlertBot’s external website monitoring system and its TrueBrowser™ technology to monitor both sites for three weeks, spanning from June 5, 2017 to June 26, 2017. Not surprisingly, the performance proved to be reliable for both sites. Neither service’s site went down, but as usual, one did prove to perform a little faster than the other.

Reliability

For the reliability evaluation of a website, we look for failure events (like when a page doesn’t fully load or it is completely down), and we look for what caused those failures.

Both sites performed quite well during the time period, but McDonald’s site experienced a hiccup on the first day of the test, June 5. It was a timed-out warning (meaning the site failed to load in the expected time period), but it didn’t last longer than a couple minutes, and didn’t seem to affect the site for very long. Otherwise, their site was pretty stable. (McDonald’s 9/10)

On the other hand, Burger King’s site didn’t experience any confirmed failure events at all and experiencing complete uptime during the test time. However, it did see two transient errors—one a slow page notice and one a brief timed-out notice—for less than a minute that affected the site’s overall performance from a single location. When errors like these occur, AlertBot tests them from a second location to confirm if the error is widespread or just a brief localized blip. In these instances, the error only occurred from just one test location and didn’t qualify as a downtime event.    (Burger King 9.5/10)

Speed

When evaluating a website’s speed, we look at the time it takes the site’s homepage to render and load to the point of being fully interactive by the user.  We run these tests inside real Firefox web browsers using AlertBot’s TrueBrowser ™ monitoring.

Both sites are quite graphics-heavy, so it doesn’t surprise me that they may experience some slowness at times.

McDonalds’ loading speeds averaged around 9.5 seconds per day, with its best time being 10 AM on   Monday, June 12 at 5 seconds and its best day being Monday, June 26^th with an average of 8.8 seconds. Its worst day was Monday, June 5^th, when the load time crawled to an average of 12.7 seconds, while the worst time was on Wednesday June 7^th at 11 PM with a pitiful 17.6 seconds. (McDonald’s 8.5/10)

Burger King performed significantly better by comparison. Overall, the site averaged 3.6 seconds for its load time, which is pretty good. Its best day was Wednesday, June 19^th when it averaged 3.5 seconds, with its best load time being on Wednesday, June 14^th with a speedy 1.8 seconds load time at 6 AM. Monday, June 5 was the worst day, seeing a 6.1 seconds load time (which was still better than McDonald’s BEST day), and their worst time being Saturday, June 17^th at 10 AM with 8.5 seconds. (Burger King 9.5/10)

Geographic

It’s always interesting to see how sites perform differently across the world. If we look exclusively at the United States, it’s intriguing to see which states regularly see faster or slower times than others.

It seems to be the norm for California to record the fastest speeds, and the same holds true for McDonald’s. However, surprisingly, New Jersey was the next fastest state on the list. Comparatively, the fast food chain legends saw the slowest load times in Georgia and Utah.  (McDonald’s 9/10)

Burger King, for the most part, saw stronger returns across the board, with California, Colorado, Virginia, Missouri, Washington and Texas all pinging approximately 1 msec. Their slowest locations were North Carolina and also Utah. (Burger King 10/10)

Usability

For usability, we select a common task a user might typically try to accomplish when visiting the sites and replicate it. For our previous Showdown, we tested out how the experience of tracking a real package might look when using two popular parcel services. For this Showdown, we’ll see what the experience is like to use their respective websites to look up the menu and nutritional information on each company’s signature burgers.

For each of these processes, we started by opening a new tab in Google Chrome and typing in the site’s URL.

From the point of typing www.mcdonalds.com into our Chrome browser and navigating until we could find the Big Mac nutritional info, it took 26 seconds. We were held up at first by a prompt on the front page that asked us to join their email list. The browser also wanted to access our location. From closing out the pop-up on down to finding the Big Mac info, it took five mouse clicks.

Now, from the point of typing www.burgerking.com into our Chrome browser, it took four mouse clicks and 18 seconds to get to the Whopper’s nutritional info. BK’s design is much simpler, so we see why their load times were faster.

We liked the aesthetic of both websites, but McDonalds has a slightly more modern feel in its design. However, their graphics are all-around larger and they have more going on on the page, which could be why their overall load times are slower than Burger King’s.

So, with all things considered, with the goal being able to find the nutritional info on each chain’s most popular burger, here are the Usability scores:

(McDonalds 9/10)       (Burger King 10/10)

Final Verdict

Neither site performed exceptionally well over the other, but it’s safe to say that Burger King edges out McDonalds in speed and overall performance. (Just for fun, we should follow this up with a who-has-the-better-French-Fries competition!)

So, for the fourth AlertBot Showdown, the site that gets to join the ranks of previous winners Apple, FedEx and Fandango is…

WINNER:

One of the most appealing things about ordering items online is receiving packages in the mail. Not only is it convenient for the fruits of your shopping toils to be brought directly to your door, but you can do your shopping from anywhere at any time of the day or night (and in your pajamas if you so desire). Two well-known, worldwide services that nearly everyone who has sent or received a parcel has used are UPS and FedEx. Both services are easily accessible for sending packages, and both are frequently used for receiving them. Both services also have websites that enable users to track their packages (if they’ve been given a tracking number), while also helping to provide resources for sending them out.

For our third Showdown, we set out to track the performance of these two services, trucking along until we could wrap up the results for delivery to you.

We used AlertBot’s external website monitoring system and its TrueBrowser™ technology to monitor both parcel service sites for three weeks, spanning from March 27, 2017 to April 17, 2017. Not surprisingly, the performance proved to be reliable for both sites. Neither service’s site went down, but one did prove to perform a little faster than the other.

Reliability

For the reliability evaluation of a website, we look for failure events (like when a page doesn’t fully load or it is completely down), and we look for what caused those failures.

FedEx’s website experienced not a single, solitary failure event. At the very worst, it may have experienced some slight slowness for a short period of time, but it didn’t affect their overall reliability results. (FedEx 10/10)

UPS’s website was a different story, but there were also no failure events or periods of actual downtime either. The most UPS’s site saw were a handful of warnings that the site was performing a little slower than usual, and a little slower than the average expected load time. These periods of minor slowness only lasted for about 3 to 5 minutes each.   (UPS 9.5/10)

Speed

When evaluating a website’s speed, we look at the time it takes the site’s homepage to render and load to the point of being fully interactive by the user.  We run these tests inside real Firefox web browsers using AlertBot’s TrueBrowser ™ monitoring.

Both websites have pretty basic homepages, so the load times for customers should be fairly quick (even on a slow internet connection) if the sites aren’t experiencing any server issues.

FedEx’s site speed is fantastic, averaging less than 1 second on most occasions. Its response time was recorded on Wednesday, April 5, 2017 at 0.5 seconds, while its slowest response time was on Monday, April 17, 2016 at just over 2 seconds (which is still very good). (FedEx 10/10)

UPS was also pretty good, but their best response time was about the same as FedEx’s worst response time. UPS’s best response time was 2 seconds on Tuesday, April 11, while their worst was on Monday, April 10^th with just a hair under 6 seconds. The standard used to be 7 seconds, but these days, users expect sites to load in roughly 2 seconds.  (UPS 8/10)

Geographic

It’s always interesting to see how sites perform differently across the world. If we look exclusively at the United States, it’s intriguing to see which states regularly see faster or slower times than others.

It’s also interesting to note that in most of these tests we’ve done for these Showdowns so far, California seems to frequently come out on top when it comes to website speed. With that said, FedEx seemed to perform best in California – at just under half a second, and performed the “worst” in Virginia, which still averaged around an impressive 1.1 seconds.  (FedEx 10/10)

UPS also saw its best results in California, but clocked in at around 1.4 seconds there. Texas returned the slowest results, however, averaging around 5.6 seconds. (UPS 8/10)

Usability

For usability, we select a common task a user might typically try to accomplish when visiting the sites and replicate it. For our previous Showdown, we went through the motions of ordering tickets for a recent movie on MovieTickets.com and Fandango.com, For this evaluation of FedEx and UPS, we’ll see how the experience of tracking a real package goes.

For each package tracking process, we started with having the tracking number copied onto our clipboard and then typed the URL of the test site into our browser.

From the point of typing www.FedEx.com into our Firefox browser, selecting the tracking tab at the top, pasting the tracking number into the search field on the left sidebar and clicking “Track,” it took only 15 seconds to get to the tracking results. That’s really fast! We then tried the same process again using the Google Chrome browser, for which the “region” needed to be selected first this time, it took only a second longer to complete!

Now, from the point of typing www.UPS.com into our Firefox browser, selecting the region, pasting the tracking number into the search field on the left sidebar and clicking “Track,” it took roughly 22 seconds to get to the tracking results. That’s not bad, but it’s clearly slower than our FedEx experience. We then tried the same process again using the Google Chrome browser and it took an impressive 12 seconds to complete!

So, with all things considered, with the goal being to track a package as quickly as possible, here are the Usability scores:

(FedEx 10/10)        (UPS 9/10)

Final Verdict

It’s a close match, to be honest, but we’d have to say that FedEx.com still outperformed UPS.com in the speed factor, delivering more than just highly anticipated parcels to its customers, but reliable website performance swiftly as well.

So, for the third AlertBot Showdown, the site that gets to join the ranks of previous winners Apple and Fandango is…

WINNER:

> ]]> https://www.alertbot.com/blog/index.php/2017/03/06/alertbot-showdown-fandango-com-vs-movietickets-com/ Mon, 06 Mar 2017 11:37:00 +0000 https://alertbot.wordpress.com/?p=371
Last fall, AlertBot debuted its first website “Showdown,” pitting cell phone giants Apple and Samsung against each other in an epic web performance death match (of sorts) to see whose website performed the best. (For those results – and to see who won – check out that blog here.)

For our second Showdown, we decided to grab an oversized bucket of popcorn, an unreasonably large cup of soda, and a pair of cheap, plastic 3D glasses and plopped down into the comfiest of chairs to evaluate two of the premiere movie ticket buying sites: Fandango and MovieTickets.com.

If you’re a movie buff who loves a night out reclining in front of ceiling-high silver screens to watch the latest Hollywood has to offer, chances are you’ve purchased tickets online before. And what would be more frustrating than website failure while you’re trying to combat the masses to secure your entry into an anticipated film’s opening night?
We used AlertBot’s external website monitoring system and its TrueBrowser™ technology to monitor both sites from December 26, 2016 to January 16, 2017. Not surprisingly, the performance proved to be pretty good overall, although one of the sites experienced some pretty significant issues on one of the days. Both sites saw some minor “Slow Page” warnings, but MovieTickets.com took a hit right after Christmas with a dreaded “Server Too Busy” error, meaning their website couldn’t withstand the weight of the traffic it was getting.

Reliability

For the reliability evaluation of a website, we look for failure events (like when a page doesn’t fully load or it is completely down), and we look for the causes of those failures.
Fandango’s website experienced not one single failure event. The worst things seemed to get for Fandango in this time period was a handful of minor “Slow Page” warnings on Dec. 29th and after the new year on the 2nd and 5th. (Fandango 10/10)

Meanwhile, MovieTickets.com experienced what AlertBot considered to be 13 failure events. While most of them were only 3 to 5-minute-long for slow page loads, on Dec. 27th (a Tuesday), the site saw some significant outages where the site was down and reporting a “Server Too Busy” error for nearly 6 hours! When visiting the site during this stretch of time, chances are users were met with the dreaded “Server Too Busy” error message in their web browser instead of the actual site. This would have been super frustrating for visitors (especially if you’re trying to order tickets in a jiffy). (MovieTickets.com 7/10)

Speed

When evaluating a website’s speed, we look at the time it takes the site’s homepage to render and load to the point of being fully interactive by the user. We run these tests inside real Firefox web browsers using AlertBot’s TrueBrowser ™ monitoring.
Both websites have pretty busy front pages, but both tend to change often and feature videos or Flash-driven ads and some graphic-heavy content – all of which can really compromise a website’s load time.

Fandango’s speed is solid, averaging less than 2 seconds. Its fastest day was Friday, Jan. 13, 2017 at 1.7 seconds and its slowest was Thursday, Dec. 29, 2016 at just over 2 seconds. (Fandango 9/10)

MovieTickets.com didn’t fare quite as well, unfortunately. On its best day, Tuesday Jan. 3, the front page took almost 4 seconds to load. On its worst day, Dec. 27 (also a Tuesday), it took almost 7 seconds to load – which is definitely below the current online industry’s website load time standards. (MovieTickets.com 7/10)

Geographic

It’s always interesting to see how sites perform differently across the world. If we look exclusively at the United States, it’s intriguing to see which states regularly see faster or slower times than others. Fandango saw the fastest load times in California (I suppose that makes sense, given the movie industry being centered there), with the slowest happening in Texas. Still, the slowest times were typically still under 2 seconds of load time, with Washington, Virginia and Texas all seeing load times around 2 seconds or pushing 3 seconds. (Fandango 10/10)

For MovieTickets.com, it’s a different story. We already know they struggled with speed, but the question here is – where? California is also the best location for MovieTickets.com, with load times around 2.7 seconds. The worst, again, is Texas, with almost 6.5 seconds. Florida and North Carolina also performed well, while Washington joined Texas as one of the slower locations. (MovieTickets.com 8/10)

Usability

For usability, we select a common task a user might typically try to accomplish when visiting the sites and replicate it. For our previous Showdown, we chose the task of ordering the latest cellphone from the respective sites of Apple and Samsung. For these sites, we’ll see how the experience of ordering movie tickets compares to one another.

Starting with selecting a movie to buy tickets for, we approached each site with the goal of ordering two tickets for the recently released The LEGO Batman Movie.

By selecting a brand new film, it was easy to find the film on the homepage of Fandango.com and start clicking through to order tickets. From the point of typing www.Fandango.com into our Firefox browser, clicking on the LEGO Batman Movie poster, putting in our zip code, selecting the next available time and number of tickets, it took roughly 40 seconds to get to the Fandango checkout. That’s not bad. If this were for real, we would have probably spent extra time checking our show time options a bit more, choosing 2D over 3D, etc. But for this task, we figured it’s best to keep it simple. The whole process took about 4 clicks of the mouse with a little typing to put my zip code in.

For MovieTickets.com, we found the experience to be mostly the same. Except, when we put our zip code in, it seemed like MovieTickets.com gave more options right off the bat. Fandango suggests the closest theater for your zip code and the first batch of showings it finds (in this case, it’s a 3D showing), while MovieTickets gives you the full list of showings and format options. Our experience felt more thorough with MovieTickets, getting more choices right away. But we also feel like more options delayed our browsing experience because we had to read and think more. Still, the browsing time for MovieTickets.com – to complete the same process – was the same 4 clicks and around the same 40 seconds.
We tried both again from Google Chrome, and not even factoring in our newfound familiarity with the process for both sites, we found both processes to take 30 seconds each this time. They’re easy sites to navigate and their load times were swift.

So, with all things considered, with the goal being to get tickets for one of the most recent films released ordered, here are the Usability scores:
(Fandango 9/10)      (MovieTickets.com 10/10)

Final Verdict

We’d say Fandango won by quite a bit, given their better web performance over MovieTickets.com, but I think I enjoyed the usability of MovieTickets.com over that of Fandango’s. The fact that Fandango doesn’t present show time options upfront is a little unfortunate.

Still, one cannot ignore good web performance, and I have to hand it to Fandango for achieving impressive site speed and reliability. So, with that said, the result of the second AlertBot Showdown is…

WINNER:

Allentown, PA / December 13, 2016 / PR Newswire
InfoGenius.com, Inc., a software company and developer of the leading TrueBrowser®-based web application monitoring solution, AlertBot, is pleased to announce the launch of a new series of AlertBot blogs the team has dubbed ‘Website Showdowns.’ AlertBot’s Showdown blogs will feature monitoring results from competing websites, showcasing AlertBot’s TrueBrowser® technology at work, which combines advanced performance tracking and error detection with real web browser testing to provide customers with best-in-class website monitoring solutions.

The AlertBot Showdown blogs will evaluate each website’s performance based on four categories, including reliability, speed, geographical performance and usability, complete with time-based trends and detailed analytics.

This month’s scrimmage pits rivals Apple.com against Samsung.com. With two titans of industry like these going head to head, the results were, for the most part, not unexpected.  Read the full report here.

AlertBot continues to remain on the cutting edge of website performance. With 85 Global Test Locations operating over 7 Internet Backbones developed during the past decade, AlertBot has established their reputation in real-world private industry applications. AlertBot serves over 10,000 users spanning 6 continents worldwide with 200 million website checks per month. Their Synthetic Monitoring is designed to detect all possible application errors and collect important performance metrics as part of its monitoring routine.

About AlertBot:
Since launching in 2006, AlertBot has provided industry-leading TrueBrowser® web application monitoring. Thousands of companies trust AlertBot to continuously monitor their mission critical websites for errors and performance issues that affect user experience. Visit www.AlertBot.com for more information.

About InfoGenius.com, Inc.:
Founded in 1999 by a group of engineers, InfoGenius prides itself in building and delivering quality enterprise-class services that help businesses, both small and large, realize their greatest potential online. InfoGenius conducts its business through its network of independently branded services including AlertBot, ELayer and UptimeSafe. Visit www.infogenius.com for more information.

If website performance is important to you, then you’ll know just how vital it is to the success of your business’s website. To AlertBot, web performance is everything. This topic is of great interest to us, as we live and breathe web performance on a daily basis. It got us thinking – we all love a good head-to-head, mano-a-mano rivalry: Tyson vs Holyfield. The Hatfields vs The McCoys. The Jets vs The Sharks. Prego vs Ragu. Luke vs Vader. So we thought, what if we tracked the performance of two websites within a certain genre and pit them against each other. Who has the better website performance? Who will come out on top?

Every Fall, Apple releases a new iPhone like clockwork. But Apple isn’t the only game in town. With Apple celebrating the recent release of the iPhone 7, Samsung has their Galaxy S7 (which released in March). So we decided it was fitting to have Apple.com go toe-to-toe with Samsung.com. The results were not unexpected. (Well… most of the results.)

When you have companies as serious about their products and innovation as these two, you’d expect their websites to perform impeccably. And, honestly, they did.

We tracked the sites and examined three weeks in September – the 1^st through the 22^nd – to see how these sites performed.  During this timeframe, we tested the websites around the clock from 17 different locations across the United States using AlertBot’s TrueBrowser Monitoring.  The tests were performed by loading their homepages inside real Firefox browsers and giving them a maximum of 7 seconds to render and become fully interactive.  Anything beyond 7 seconds (which is well above the average expected page load time) was considered a failure.  After compiling all the data, this is what we found:

Reliability

When we examine the reliability of a website, we’re looking for failure events – like when pages don’t fully load or go down completely – and try to identify the cause of the failure. Some common causes are slow third-party code used on pages, incomplete page content, actual web server failures, etc.

For Samsung, their website experienced no failure events during our test period, and achieved 100% uptime. This is definitely above the norm for website performance, but not unexpected for a company like Samsung.  We would have loved to find some juicy failure-generated data to talk about, but Samsung’s website was as clean as a whistle on this front. (Samsung Score 10/10)

Similarly, Apple.com experienced no failure events and achieved 100% uptime. While I’d expect nothing less from a juggernaut like Apple, it’s still impressive when you consider other retailers that experience frequent website issues. (Apple Score 10/10)

Speed

When we evaluate a website’s speed, we’re looking at the time it takes the site’s homepage to render and load to the point of being fully interactive.  We run these tests inside real Firefox web browsers using AlertBot’s TrueBrowser ™ monitoring.

While evaluating the speed of the websites specifically, Samsung.com’s fastest day was Friday, Sept. 2^nd, with its slowest day being Saturday, Sept. 3^rd. On average, the site’s homepage took  around 1.7 seconds to load. That’s not bad at all! Some recent studies have shown that the expected load time for sites in ecommerce to be 2 seconds or less, so Samsung definitely fits the bill here. Some online studies have determined that if an ecommerce site is making $100,000 per day in sales, just a 1-second page delay could potentially cost the company $2.5 million in lost sales per year.  (Ouch!) On its slowest day (Sept 3^rd), Samsung.com saw some load times in the range of over 7 seconds at times during the day.     (Samsung Score 9/10)

While evaluating Apple.com’s speed, its fastest day was also a Friday, on Sept. 9^th, with its slowest day being a Friday, Sept. 2 (coincidentally, the same day Samsung experienced its fastest load time), in which the site took 10 seconds to load at times (due to a slow page file error). However, on average, the site’s homepage took  around 1.3 seconds to load. It’s a hair faster than Samsung’s, but they’re close to each other.    (Apple Score 9/10)

One major mistake a lot of websites make is utilizing large graphic file sizes or third party code on their home page, and it’s things like that that can really bog down a website’s speed. It’s not surprising that both Apple and Samsung avoid this mistake. While both of them display large, beautiful images on their front page, they optimize their file sizes well.

Geographic

When we looked at Samsung.com’s performance at various locations around the United States, we found that the site consistently took longer to load in Texas, with its slowest time occurring in Washington, DC, but was the fastest in Florida, North Carolina and Georgia. Samsung.com had just a handful of minor site hiccups during this three-week period, but only at specific locations. For example, AlertBot registered 5 instances of slower load times: once in New York, twice in Florida, once in Washington DC and once in Washington state. Still, it managed to perform more than adequately at these locations overall.  It wouldn’t be uncommon for websites to experience significant trouble in certain areas of the country on a regular basis, but we expect only the best from Samsung.   (Samsung Score 9/10)

When we looked at Apple.com’s website performance from various locations around the U.S, we found that the site consistently took the longest to load in Utah and Texas, but was the fastest in Florida and North Carolina. It’s intriguing to note that both Florida and North Carolina saw the best load times for both websites, while Texas was one of the slowest for both.  AlertBot did catch two instances of slower load times and a slow javascript file in Illinois, but neither problem caused the site to go completely down.   (Apple Score 9/10)

Usability

For usability, we select a common task that a typical user might want to perform on sites like these. Then, using hands-on testing, we perform the same task on each website while timing how long it takes to complete and how many mouse clicks it takes to get the job done.  This time, we decided to approach each site with the intention of purchasing their latest phone.  We timed how long it would take from the point of entering the URL into the browser on through to getting the phone into the online shopping cart.

From the point of typing in “Apple.com” and clicking through their site from the phone product pages all the way to the shopping cart, it took 45 seconds (and 7 clicks of the mouse) for us to add a SIM-free 256GB “jet black” iPhone 7 to the online “shopping bag.” (There’s an additional click, however, to view the cart when you’re done adding the phone to it.)

From typing “Samsung.com” into our browser and clicking through to add a Samsung Galaxy S7 Edge 32GB “unlocked” phone into our shopping cart and viewing the virtual bag, it took a shocking 1 minute and 30 seconds (in 5 mouse clicks)! We used Google Chrome as our browser for both websites and the Samsung site froze up twice during the process (in fact, we accidentally added TWO of the same phone to our cart because we were trying to click through to the cart and it was unresponsive). Just to be fair, we tried it again, and it hung up yet again during the ordering process, but this time it was a little under a minute to get to the shopping bag. All of this happened on Chrome’s latest version, too. We know web browsers can be super fickle, though, so we decided to try it a third time, this time with Mozilla Firefox, and it took 20 seconds to get the same phone into the shopping cart. On Apple’s site, for the iPhone, there are a lot more choices – from storage space to phone color – to choose from, so it makes sense as to why that process might take longer. But it is rather alarming that Samsung’s site experienced THAT much trouble while just trying to add their phone to the shopping cart.

Just to compare via Firefox, then, we re-performed the timed test for Apple.com. One could argue that re-tests don’t account for newfound familiarity with either site, but it took 25 second to add the same iPhone 7 to the shopping cart. While that’s a few seconds slower than Samsung, we also didn’t experience any problems on either browser with Apple’s site.

All things considered, here are the Usability scores:

(Samsung Score 7/10)          (Apple Score 9/10)

Final Verdict

The performance of both sites were very, very good and quite close to one another. Apple’s site just barely edged out Samsung’s on speed and geographic performance, while both matched each other on reliability. Despite their slight differences, they both performed at the top of their game in online performance. However, after factoring in our usability testing, where Apple’s site performed much more consistently, the winner for the very first AlertBot Showdown is clear:

WINNER: