Category : A/B testing
Ecommerce trends at Paris Retail Week
Physical or digital? We found merchants doubling down on both at Paris Retail Week. At the big event in Paris last month, we found retailers intent on merging the online and offline shopping experience in exciting new ways. See who we met and what the future of digital might hold for global ecommerce. Representatives from our European team had a great time at the big ecommerce event, one of the 'sectors' at Paris Retail Week. Outside of the event, it was great to have a chance to catch up with Maukau, our newest Shopify agency partner in France. (Bonjour!) Among the huge amount of digital sales and marketing trends we observed throughout the week, a few emerged again and again: mobile-first, phygital experience, and always-on, multi-channel marketing. Getting phygital Phygital? Is that a typo? Hardly. It’s the latest trend in ecommerce, and it was prevalent everywhere at Paris Retail Week. Phygital combines “physical” and “digital” experiences in a new ecosystem. This offers the consumer a full acquisition experience across different channels. From payment providers to marketing agencies, everyone was talking about going phygital. One of our favourite presentations was by AB Tasty. They focused on how optimising client experience can boost sales and conversions in the long-term. It’s not enough to promote your products, nor to link to an influencer for social proof -- you need to create a full customer experience. Starbucks and Nespresso are good examples of how this works offline, assuring that a customer who comes in to drink a coffee will linger around for the next 20-30 minutes. By keeping the customers in the shop, they will eventually order more. The goal is to reproduce this immediately sticky experience online too, and focusing on web engagement benchmarks is the best way to track your progress here. Using the example of conversion rate optimisation (CRO) for mobile apps, AB Tasty's Alexis Dugard highlighted how doing data-driven analysis of UI performance, on a very detailed level, can help clarify how mobile shopping connects with a wider brand experience. In the end, customer experience means knowing the customer. 81% of consumers are willing to pay more for an optimal customer experience. Brands that are reluctant to invest in customer experience, either online or offline, will hurt their bottom line, even if this isn't immediately apparent. Those brands that do invest in multi-channel customer experience are investing in long-term growth fuelled by higher Average Order Value (AOV). 81% of consumers are willing to pay more for an optimal customer experience -- the statistic speaks for itself! Another great talk was from Guillaume Cavaroc, a Facebook Academie representative, who discussed how mobile shopping now overlaps with offline shopping. He looked at experiments with how to track customers across their journeys, with mobile login as a focal point. In the Google Retail Reboot presentation, Loïc De Saint Andrieu, Cyril Grira and Salime Nassur pointed out the importance of data in retail. For ecommerce sites using the full Google stack, Google data represents the DNA of the companies and Google Cloud Platform is the motor of all the services, making multi-channel data more useful than ever in assisting with smart targeting and customer acquisition. The Google team also stated that online shopping experiences that don’t have enough data will turn to dust, unable to scale, and that in the future every website will become, in one way or another, a mobile app. In some ways, "phygital" really means mobile-first. This message that rang out clearly in France, which is a mobile-first country where a customer's first encounter with your brand or product is inevitably via mobile -- whether through a browser, specific app or social media feed. [subscribe] Multi-channel experience (and the data you need to optimise it) Physical marketing is making a comeback. Boxed CEO Chieh Huang and PebblePost founder Lewis Gersh presented the success of using online data for offline engagement, which then converts directly back on the original ecommerce site. Experimenting heavily in this area, they've seen personalised notes on invoices and Programmatic Direct Mail (with the notes based on viewed content) generate an increase of 28% in online conversion rate. Our real-world mailboxes have become an uncluttered space, and customers crave the feel of a paperback catalogue or simple postcard, to name just a bit of the physical collateral that's becoming popular again -- and being done at a higher quality than in the years of generic direct mail. Our real-world mailboxes have become an uncluttered space, and customers crave the feel of a paperback catalogue or simple postcard. However, data is still the backbone of retail. In 2017 Amazon spent approximately $16 billion (USD) on data analysis, and it was worth every penny, generating around $177 billion in revenue. Analysing declarative and customer behaviour data on the shopper’s path-to-purchase is a must for merchants to compete with Amazon. Creating an omni-channel experience for the user should be your goal. This means an integrated and cohesive customer shopping experience, no matter how or where a customer reaches out. Even if you can't yet support an omni-channel customer experience, you should double down on multi-channel ecommerce. When Littledata's customers have questions about the difference, we refer them to Aaron Orendorff's clear explanation of omni-channel versus multi-channel over on the Shopify Plus blog: Omni-channel ecommerce...unifies sales and marketing to create a single commerce experience across your brand. Multi-channel ecommerce...while less integrated, allows customers to purchase natively wherever they prefer to browse and shop. Definitions aside, the goal is to reduce friction in the shopping experience. In other words, you should use anonymous data to optimise ad spend and product marketing. For marketers, this means going beyond pretty dashboards to look at more sophisticated attribution models. We've definitely seen this trend with Littledata's most successful enterprise customers. Ecommerce directors are now using comparative attribution models more than ever before, along with AI-based tools for deeper marketing insights, like understanding the real ROI on their Facebook Ads. The new seasonality So where do we go from here? In the world of ecommerce, seasonality no longer means just the fashion trends of spring, summer, autumn and winter. Online events like Black Friday and Cyber Monday (#BFCM) define offline shopping trends as well, and your marketing must match. "Black Friday" saw 125% more searches in 2017, and "Back to School" searches were up 100%. And it isn't just about the short game. Our own research last year found that Black Friday discounting is actually linked to next-season purchasing. Phygital or otherwise, are you ready to optimise your multi-channel marketing? If not, you're missing out on a ton of potential revenue -- and shoppers will move on to the next best thing.
How Pufushop used our ecommerce benchmarks to grow sales
"Is my conversion rate good or bad?" We built Littledata's benchmarking feature to help you say goodbye to guessing games and start automatically benchmarking your site against top performers. Now that our benchmark tool has been around for awhile, we've started to get a sense for which ecommerce sites are using it most effectively. In other words, we've seen how benchmarks can help websites increase revenue - not in theory but in actual practice. Littledata has now helped hundreds of companies understand where their performance is compared with other websites in their niche, using our benchmarking algorithms and clean user interface. But can benchmarks really help you grow sales? I understand if you want to see the data for yourself. One of our long-term customers makes for an ideal case study. Case study - Pufushop Over the course of 2017, we helped Pufushop, a Romanian ecommerce site, understand if their website changes were helping to increase performance - and where they still had work to do. Pufushop is a retailer of baby goods, with a main focus on baby carriers. The products in their store are all premium quality and from top vendors, so comparing them with just any other baby store wouldn't have been relevant. Instead, we compared their ecommerce metrics with specific benchmark segments that were most relevant to their market landscape and business goals. Ecommerce benchmark segments Benchmarking is used to measure and compare the performance of a specific indicator, and it's most useful when you map that data onto your internal KPIs and compare performance against similar sites. Littledata specialises in ecommerce analytics and our benchmark population now includes Google Analytics data from almost 10,000 sites. We break that data into specific categories, such as Marketing, Ecommerce and Speed (site performance), and within each category you can filter by industry, location, website size, and more. Littledata aggregates reliable data from those thousands of high-performing websites so that you can focus on results. In this customer's case, we analysed their website and business model to provide 5 relevant benchmark segments: Romanian websites to compare KPIs across regional market Small SEO websites because 60% of Pufushop's traffic comes from search engines SEO-driven online stores (more generally, to see how they compare) General online shopping websites across the globe, to get a sense for how their funnel compares And a specific revenue per customer category based on shoppers' average basket spend (sites with a similar average order value, no matter the sector) Key metrics Web behaviour is not necessarily consistent across industries. We started Pufushop's analysis by looking at key ecommerce KPIs such as Checkout completion rate, Ecommerce conversion rate and Add-to-cart rate, but we didn't just pull these metrics blindly. Starting with the first month, February 2017, we looked at how other stores with a similar average basket value were performing. This helped our client establish what was working and what could be improved. As we worked with them to make sure everything was tracking correctly (after all, benchmarks are only as useful as your data is accurate), they could also check these benchmarks directly in the Littledata app. Results Now for the first time, both Pufushop's Marketing Director and Senior UX Designer had clarity on which areas of the website could be improved to increase sales. Based on the benchmark data they could see that the main places to improve were: The checkout process (to increase the checkout completion rate) Product pages (to increase the add-to-cart rate) Resolving those two main issues will automatically resolve the e-commerce conversion rate KPI and will indirectly influence the Revenue per customer. Pufushop decided to use Google Optimize in order to improve the checkout completion rate. Using Google Optimize is an easy-to-use, fast and scalable tool in order to A/B-test different experiences on the checkout page. Pufushop conducted a variety of targeted experiments, including: Shortening the checkout process Eliminating unnecessary fields Testing variants of checkout pages Split-testing different product pages Testing a variety of shipping costs After a couple of months of testing, the results were significant: The add-to-cart rate grew from 3.7% to 5.5% The checkout completion rate jumped from 52.8% to 89.7% Now those are some real results! Having a direction as well as a target helped Pufushop's digital team to focus on clear, achievable goals. As they continue to grow, we're glad to have them as a part of the Littledata family. [subscribe] Ready to benchmark your site? If you're in the same place as Pufushop was a year ago, here's a quick guide for how to use ecommerce KPI benchmarks to improve your store performance. Sign up for Littledata's main app or Shopify app Look at the benchmark data and pick an industry and a set of KPIs - the right sectors and segments will help you optimise campaigns Use tools like Hotjar and Littledata's automated reporting to analyse user behaviour around those benchmarks and define a short list of actions you're going to take Use Google Optimize or hire a developer to put those actions into place Monitor how users are interacting with the changes When you have sufficient data to see a clear relationship between those changes and an increase in traffic, revenue or conversions, make those changes permanent and move on to focus on a new set of KPIs Keep in mind that there are situations where the KPIs will show you issues of wrong messaging, for example of a product page or advertisement - technical issues where the change is fairly easy to make. In other cases, you will need to develop a long-term strategy for radical changes to your website, such as altering your checkout process. The online environment is a fast-moving industry, so you need to be agile and ready to change accordingly. Either way, we're here to help you scale with data-driven strategies for sustainable growth. Now stop reading this post and start benchmarking your site! Note: In order to maintain data-confidentiality, KPI values have been altered in this case study (the results are real, only the benchmarks have been adjusted).
What to test with Google Optimize
So you’ve got a brand new tool in your web performance kit – Google Optimize – and now you want to put it to good use. What can you test with Optimize and how does it work? Firstly, what are the different options for setting up an experiment? AB Test Using the in-page editor you can create an altered version of the page you wish to test. This could be a change of text copy, different styling, or swapping in a different image. You can also add new scripts or HTML if you’re familiar with coding. The way this works is Optimize adds a script after the page loads to manipulate the page text, images or styles. I recommend not switching header elements or large images using this method as, depending on your website setup, there may be a noticeable flicker– try a redirection test below. You can create many versions with subtly different changes (C, D and E versions if you want) – but remember you’ll need a large volume of traffic to spot significant differences between lots of variations. You can also limit the test to a certain segment of users – maybe only first time visitors, or those on mobile devices. Multivariate Test Similar to an AB test, a multivariate test is used when you have a few different aspects of the page to change (e.g. image and headline text) and you want to see which combination is most engaging. To get a significant result, you'll need a large volume of traffic - even more than testing many options in AB tests. Redirection Test This is where you have two different versions of a page – or a different flow you want to start users on. Optimize will split your visitors, so some see the original page and some are redirected to the B version. A redirection test is best when the page content or functionality is very different – perhaps using a whole different layout. The disadvantage is you’ll need a developer to build the B version of the page, which may limit the speed of cycling tests. Personalisation Personalisation is not officially supported by Optimize right now, but we’ve found it to be a useful tool. You can assign 99.9% of the visitors who match certain criteria to see the alternative version of the page. An example is where you have a special offer or local store in a particular city - see our step-by-step local personalisation example. You can ensure that all the visitors from that city see a different version of the page. Unfortunately on the free version of Google Optimize you are limited to 3 concurrent ‘experiments’ – so it won’t be a good solution if you want to run similar personalisation across lots of cities or groups of users. Next the question is where to start with tests... Start with the landing pages Landing pages get the greater volume of traffic, and are where small visual changes (as opposed to new product features) make the biggest difference to user engagement. This greater volume allows you to get a significant result quicker, meaning you can move on to the next test quicker. And keep on improving! So what exactly could you test using Google Optimize? Here are six ideas to get you going. 1. Could call-to-actions (CTA) be clearer? Changing the colour or contrast of a key button or link on the page (within your brand guidelines) usually results in more visitors clicking it. This might involve changing the style of the CTA itself, or removing elements close by on the page – to give the CTA more space to stand out. [subscribe] 2. Are you giving the user too many choices? In Steve Krug’s classic Don’t Make me Think he explains how any small confusion in the user’s mind can stop them making any choice. Every choice the user has to make is an opportunity for them to give up. Try hiding one of the options and seeing if more users overall choose any of the remaining options. 3. Is the mobile page too long? As many sites move to responsive designs that switch layout on smaller screens, this has led to mobile pages becoming very long. User may get ‘scroll fatigue’ before then get to critical elements on the page. Try cutting out non-essential sections for mobile users, or editing copy or images to make the page shorter. You could also try switching sections so that the call-to-action is higher up the page on mobile – although this is harder to achieve without a redirection test. 4. Is localisation important to your users? You may have discussed providing local language content for your users, and been unsure if it is worth the costs of translation and maintenance. Why not test the benefits for a single location? As with the personalisation tests, you can show a different local language (or local currency) version of the page to half the users in the single location (e.g. Spanish for visitors from Mexico) and see if they convert better. 5. Does the user need more reassurance before starting to buy? It easier to build experiments which remove elements to the page, but you should also consider adding extra explanation messages. A common problem on ecommerce stores is that visitors are unsure what the shipping charges or timing will be before adding to cart. Could you add a short sentence at the start of the journey (maybe on a product page) to give an outline of your shipping policy? Or maybe some logos of payment methods you accept? 6. Changing header navigation If your site has a complex mix of products that has evolved over time it may be time to try a radical new categorisation – maybe splitting products by gender or price point rather than by type. For this test, you’ll want to target only new visitors – so you don’t confuse regular visitors until you’re sure it’s permanent. You will also need to make the navigation changes on all pages across the site. Good luck! Littledata also offering consulting and AB testing support, so please contact us for any further advice.
4 common pitfalls of running conversion rate experiments from Microsoft
Personalising your site for a local event with Google Optimize
Google Optimize versus Optimizely
Tips to optimise your ecommerce landing pages
Are your ecommerce landing pages suffering from poor conversion rate because people aren't engaging? First impressions are everything, and more so online, so your task is to figure out which on-site improvements will help you towards your goals. Once you start optimising, it's a continuous process of reviewing, changing, testing and refining - aiming to find out what is most appealing to your customers, what they like and care about, what makes them trust you, what encourages them to purchase. There is always room for refinements so here are some tips on what you should consider when reviewing your pages. What are you trying to achieve? Before starting testing and implementing the changes on your landing pages, you have to be clear about what you want to accomplish. Whilst the end goal for an online store is to increase sales, at times you might also want to get more sign ups, or improve views of or engagement with product pages. Think about what success will look like as that will help with planning your optimisation tests. How are you going to measure it? If you are clear about what you are trying to achieve, it will be easier to set measurable targets. Are you looking to increase your sales by 10% or pageviews of products by 15%? Or maybe you want your potential customers to browse further and spend more time reading content? Further engagement can also be demonstrated by the site visitor scrolling down the page if you have long product or category pages. In which case you'll want to track how far down the page they get to. I believe in keeping reporting straightforward so when testing focus on tracking important metrics only. Ideally just one if you can, or a few if you have to, but that will help focus on measuring what is most important for your business at the time. Assuming you are using Google Analytics, like most of people looking after digital performance, set up goals to monitor how customers are converting. Our web-based software also makes it easy to keep track of on-site changes are by reporting on changes in trends, goals, pages. Who are you targeting? User-focussed content is more effective at engaging your customers and improving your conversion rates. So you should write up your customer personas to be clear about who you are targeting with landing pages. This also applies to general look and feel of your ecommerce site. Most importantly, include with personas what problems your customers are trying to solve or what they are trying to achieve. Once your team knows who your ideal or typical customers are, then it will be easier to focus on creating more relevant and engaging content on those pages. Do you have a clear value proposition? Value proposition explains why you’re better than or different from your competitors, and what you can deliver that they can’t. When writing it up, focus on benefits not features. It’s not always about the product looking top notch (unless you’re the industry or company where that matters of course) so it is more about how you can alleviate their problem. Check out how to write your value proposition by following Geoffrey Moore’s model. Does your copy reflect your value proposition? Once you have your customer personas and value proposition, review existing content on the site against how you describe what your clients are looking for. Check if it fits with what they are looking for, explains how you can solve their problems or fulfill their desires. The copy on your site has to reflect how you can improve your potential customers lives through what you offer. A great copy informs, compels, captivates, reflects what people search for and promotes key benefits. Econsultancy have compiled a great set of advice from experts on writing copy for product pages. Also, check out Copyblogger Demian Farnworth’s articles for superb advice on writing copy. Have you found your winning call to action? This is very important – test your call to action until you find the best performing one. Your call to action is like a visual sign that guides the buyer towards a specific action you want them to complete. Different things work for different sites. Start off with trying simple changes like different text, colour, shape, size or placement of the button to figure out what is most effective for your page. If small changes aren’t helping, then try a more drastic change of the button or page. Do your pages load fast? This is pretty self-explanatory. Slow page loading speed might drive your potential customers away from your online shop, so you should regularly check whether they can view your products within 3 seconds (Source: Radware). If you’re using Google Analytics, you can use Site Speed reports to check how you’re performing and get advice on where to improve. If you don’t have Google Analytics, you can use their online tool PageSpeed Insights. Other tool worth checking out is GTMetrix where you can grade your site's speed performance and get a list of recommendations. Do you need to optimise for mobile? It’s a very common fact that more and more people are using mobile devices to browse and buy online. But unless you have unlimited budget for ensuring that your ecommerce site is optimised for mobile, it is best to check in Google Analytics first whether you need to do it now. If you go to Google Analytics > Audience > Mobile > Overview report, you will get a breakdown of device categories that buyers are using to visit your online store. Here you can see that the majority of customers, almost 93% are using desktop so in this case (assuming you have a limited budget) you might want to make sure you have a responsive site at the very minimum, and leave a full optimisation for mobile device for later when there is a sufficient need. Now, if results were different and let’s say you had 60% of people visiting your site via mobile devices, then you would want to ensure that they’re getting the best experience on their device and don’t leave the site to buy from a competitor instead. Are your test results statistically significant? Evaluating your AB test results isn't quite as simple as looking at the highest conversion rate for each test, which would be an incorrect way to interpret the outcome. You want to be confident that results are conclusive and changes you tested will indeed improve your conversion rates (or not, depending on the outcome of testing). That's where statistical significance comes in. It gives you assurance about the results of your tests whilst taking into consideration your sample size and how confident you want to be about the importance of the results. By reaching over 95% statistical confidence in testing results, you can be sure that the winning variation performed better due to actually being an improved version, and not simply due to change. You can easily find a calculator online that tells you if your AB testing results were statistically significant and you should conclude the test or not - for example, try the calculator by Kissmetrics or Peakconversion. There is no one winning formula for how to make your pages more effective, but you have to be pro-active to figure out what they are - so keep testing until you do. Have any questions? Leave a comment below or get in touch with our experts! Image Credit: Stocksnap.io
Subscribe to Littledata news
Insights from the experts in ecommerce analytics
Get the Littledata analytics app
Start your free 14-day trialLearn More