Copy/design doc here - https://docs.google.com/document/d/1ogPDROmRzXJUpLmCJhFhkGnrcurAYJqsT__oad7MFiw/edit

Experiment doc: https://docs.google.com/document/d/1Nn-Fu_ni_GIapVF7nwq2A-1iqQXd7e2tDEPzl1xAUI4/edit?pli=1#heading=h.2zolu8dr3dsb

Full-fidelity HTML mockups (for reference only - already converted into jinja templates in the branch)

WIP branch is here: https://github.com/mozilla/bedrock/tree/bug-1392855-cliqz-funnelcake-experiment

WIP Demo: https://bedrock-demo-agibson.us-west.moz.works/de/firefox/56.0/firstrun/?f=119 https://bedrock-demo-agibson.us-west.moz.works/de/firefox/56.0/firstrun/?f=120 https://bedrock-demo-agibson.us-west.moz.works/de/firefox/56.0/firstrun/?f=121 https://bedrock-demo-agibson.us-west.moz.works/de/firefox/56.0/firstrun/?f=122

Latest email update from Javaun: Our new allotment of Funnelcake branches (there are 4): - Control 1 (Firefox, 2 search bars) - 119 - Control 2 (Firefox: unified search/awesome Bar ) -120 - Firefox + Cliqz with Google search suggestions - 121 - Firefox+ Cliqz without search suggestions - 122 Suggested Changes to First Run Page 1. I recommend we just use the pure Firefox branding and drop the Firefox+Cliqz variation as we've done in v2 Chip.de test. - It's going to greatly simplify things, but mostly - Prior evidence is that it's going to be widely rejected by users on the Fx Downloads page, since it's a foreign brand (and therefore will impact trust) 2. We'll need to change the inline screenshot (remove the second pane that has the privacy panel). And change/remove the text that goes with it. 3. I think we should consider another first-run page for the control 2 (unified Firefox). The would be almost identical to the page we use for the experimental branches (Fx+Cliqz), the only change is that we use a screenshot of Firefox showing search suggestions in the Awesome Bar. The purpose of the Control 2 (unified) is that we know users hate change. Users may dislike Fx+Cliqz simply because it's different, or because the bar is unified (vs 2 separate bars). It takes users time to adjust. So by having a Control with unified bar, that is a more fair comparison, and we can see how Fx+Cliqz performs against the 2 bar experience, but also a unified Stock Firefox experience. And so the purpose of another First Run is to control for the fact that Cliqz users also see a first run experience. SUMMARIZED CHANGES First run for Fx+Cliqz experimental branches - No Cliqz logo - Change screenshot to remove privacy panel - Change/remove language around the privacy panel (data remains on your computer) Optional: First run for Control 2 (unified Stock Firefox) - Same as above - Different screenshot that just shows Awesome Bar with search suggestions, but no Cliqz search recommendations

Latest html mockups

Funnelcake variations: 119 (control 1 Firefox, 2 search bars): no custom firstrun—use Fx default 120 (control 2 Firefox: unified search/awesome Bar): funnel-cake-firefox.html 121 (Firefox + Cliqz with Google search suggestions): funnel-cake-cliqz.html 122 (Firefox+ Cliqz without search suggestions): funnel-cake-cliqz.html

The above attachment contains the latest HTML mockups.

Updated firstrun pages: https://bedrock-demo-agibson.us-west.moz.works/de/firefox/56.0/firstrun/?f=119 (default) https://bedrock-demo-agibson.us-west.moz.works/de/firefox/56.0/firstrun/?f=120 (firefox template) https://bedrock-demo-agibson.us-west.moz.works/de/firefox/56.0/firstrun/?f=121 (cliqz template) https://bedrock-demo-agibson.us-west.moz.works/de/firefox/56.0/firstrun/?f=122 (cliqz template)

Thanks, Alex! I noticed that for the `cliqz-template` (121 and 122), the text in the right box below the screenshot has not yet been updated. It still reads "Mehr Privatsphäre\n Schutz für Deine persönlichen Daten", but it should read "Direkte Antworten\n Nützliche Infos in Echtzeit".

(In reply to dominik.s from comment #11) > Thanks, Alex! > > I noticed that for the `cliqz-template` (121 and 122), the text in the right > box below the screenshot has not yet been updated. > > It still reads "Mehr Privatsphäre\n Schutz für Deine persönlichen Daten", > but it should read "Direkte Antworten\n Nützliche Infos in Echtzeit". Thanks, will update

Download pages for funnelcakes: https://bedrock-demo-agibson.us-west.moz.works/de/firefox/new/?f=119 https://bedrock-demo-agibson.us-west.moz.works/de/firefox/new/?f=120 https://bedrock-demo-agibson.us-west.moz.works/de/firefox/new/?f=121 (cliqz privacy policy) https://bedrock-demo-agibson.us-west.moz.works/de/firefox/new/?f=122 (cliqz privacy policy)

Thanks! Looking at https://bedrock-demo-agibson.us-west.moz.works/de/privacy/firefox-cliqz/ (the Cliqz privacy policy) the 3rd "learn more" ("mehr erfahren") link seems not quite right. It reads "Weitere Informationen finden Sie in der Datenschutzerklärung Mehr erfahren von Cliqz. Wenn das Cliqz-Feature aktiviert ist, gilt Folgendes:". I'd expect: "Weitere Informationen finden Sie in der Datenschutzerklärung von Cliqz. Mehr erfahren" Then, after clicking on "Mehr erfahren" the following text should appear (together with the rest): "Wenn das Cliqz-Feature aktiviert ist, gilt Folgendes:" [...]

(In reply to dominik.s from comment #14) > Thanks! > > Looking at > https://bedrock-demo-agibson.us-west.moz.works/de/privacy/firefox-cliqz/ > (the Cliqz privacy policy) the 3rd "learn more" ("mehr erfahren") link seems > not quite right. > > It reads "Weitere Informationen finden Sie in der Datenschutzerklärung Mehr > erfahren von Cliqz. Wenn das Cliqz-Feature aktiviert ist, gilt Folgendes:". > > I'd expect: "Weitere Informationen finden Sie in der Datenschutzerklärung > von Cliqz. Mehr erfahren" > > Then, after clicking on "Mehr erfahren" the following text should appear > (together with the rest): "Wenn das Cliqz-Feature aktiviert ist, gilt > Folgendes:" [...] Please file an issue on the legal-docs repo for this: https://github.com/mozilla/legal-docs/

Sure: https://github.com/mozilla/legal-docs/issues/944 Looking at the https://github.com/mozilla/legal-docs/blob/master/firefox-cliqz_privacy_notice/de.md, I don't under stand how and where the collapsing of content is implemented. Does not seem to happen in this file, but maybe I am missing something. Thanks!

(In reply to dominik.s from comment #16) > Sure: https://github.com/mozilla/legal-docs/issues/944 > > Looking at the > https://github.com/mozilla/legal-docs/blob/master/firefox- > cliqz_privacy_notice/de.md, I don't under stand how and where the collapsing > of content is implemented. Does not seem to happen in this file, but maybe I > am missing something. > > Thanks! Mozorg consumes the markdown content and parses it to create HTML and the collapsable content. If something isn't right, it's probably an issue in the markdown itself.

Ok, from my side this is very nearly ready - but what we are still lacking is a solid test plan (i.e. what percentage of users this should go out to). We also need to verify that the funnelcake builds are all ready.

(In reply to Alex Gibson [:agibson] from comment #10) I just saw that the headline on the firefox (120) and cliqz templates (121 & 122) was not updated. Sorry, I missed that before. Instead of "Schneller und sicherer surfen!" it should be "Schneller surfen und suchen!" (same on both templates). I should have caught that before, but just saw it now.

(In reply to dominik.s from comment #20) > (In reply to Alex Gibson [:agibson] from comment #10) > I just saw that the headline on the firefox (120) and cliqz templates (121 & > 122) was not updated. Sorry, I missed that before. > > Instead of "Schneller und sicherer surfen!" it should be "Schneller surfen > und suchen!" (same on both templates). > > I should have caught that before, but just saw it now. Ah, my bad. Will update thanks

Ok, code-wise this should now be complete. We're going to proceed with code review, but while that happens it would be great if someone can confirm the following: Are the /firstrun templates are all correct: https://bedrock-demo-agibson.us-west.moz.works/de/firefox/56.0/firstrun/?f=119 (default) https://bedrock-demo-agibson.us-west.moz.works/de/firefox/56.0/firstrun/?f=120 (firefox template) https://bedrock-demo-agibson.us-west.moz.works/de/firefox/56.0/firstrun/?f=121 (cliqz template) https://bedrock-demo-agibson.us-west.moz.works/de/firefox/56.0/firstrun/?f=122 (cliqz template) Are the download pages correct, and are the funnelcake builds ready and being distributed when clicking the download buttons (note funnelcakes are Windows only): https://bedrock-demo-agibson.us-west.moz.works/de/firefox/new/?f=119 https://bedrock-demo-agibson.us-west.moz.works/de/firefox/new/?f=120 https://bedrock-demo-agibson.us-west.moz.works/de/firefox/new/?f=121 (cliqz privacy policy) https://bedrock-demo-agibson.us-west.moz.works/de/firefox/new/?f=122 (cliqz privacy policy) Once code review has been completed, we can then push this to staging and enable the experiment. There we'll need to try and verify that the geo-targeting is working as expected and everything is in place before moving to production.

Thanks, Alex! The firstrun pages look good to me. Just one thing: in https://bedrock-demo-agibson.us-west.moz.works/de/firefox/56.0/firstrun/?f=119 the right box stays empty (white)—but I assume this is going to be filled when loaded at startup in Firefox, right? The download pages look good, too. The Mozilla + Cliqz privacy policy still has the issue raised in https://github.com/mozilla/legal-docs/issues/944. If I understand correctly, though, this will be updated this week according to Javaun. I don't have more information on the state of the funnelcake builds at the moment.

> Just one thing: in https://bedrock-demo-agibson.us-west.moz.works/de/firefox/56.0/firstrun/?f=119 the right box stays empty (white)—but I assume this is going to be filled when loaded at startup in Firefox, right? Right, you need a specially configured Firefox profile to test the accounts form on a demo enviuronment. I don't think we need to worry about testing that here, since the bug doesn't touch the control page itself. We can verify this at deploy time. > The Mozilla + Cliqz privacy policy still has the issue raised in https://github.com/mozilla/legal-docs/issues/944. If I understand correctly, though, this will be updated this week according to Javaun. I believe that's the plan, yes. Thanks

Sorry, one more thing: On https://bedrock-demo-agibson.us-west.moz.works/de/firefox/56.0/firstrun/?f=120, the image does not seem to be centered with the title, text and the call-to-action button: the image seems to be too far right. I'll attach a screenshot to this ticket for reference.

(In reply to dominik.s from comment #25) > Sorry, one more thing: > On > https://bedrock-demo-agibson.us-west.moz.works/de/firefox/56.0/firstrun/ > ?f=120, the image does not seem to be centered with the title, text and the > call-to-action button: the image seems to be too far right. > > I'll attach a screenshot to this ticket for reference. Thanks, will fix

Thanks a lot! This issue might also be present in 121 and 121 (cliqz template), but it's less obvious there since the image is not rectangular.

(In reply to dominik.s from comment #28) > Thanks a lot! > > This issue might also be present in 121 and 121 (cliqz template), but it's > less obvious there since the image is not rectangular. Yup, the fix I've applied should apply to all variations. It's deploying to demo now, so should be updated in the next ~20 mins

Thank you Alex and Dominik for finalizing this! The privacy notice will be translated and updated by Friday I expect. Re: timeline - final update (I hope) We plan to roll out the funnelcake on Monday 10/9. The legal blog post by Denelle is expected to be out Friday.

Commits pushed to master at https://github.com/mozilla/bedrock https://github.com/mozilla/bedrock/commit/fc2f14909af08ef8501c72aac651c1efff6bc6b5 WIP [fix bug 1392855] Add Cliqz funnelcake experiment. https://github.com/mozilla/bedrock/commit/66d337722ad38745e0d0d3cd92d0ed6c52e0296d [bug 1392855] Update Cliqz firstrun designs https://github.com/mozilla/bedrock/commit/3037b40a76609dc01d9cb27b760e80601668527b Merge pull request #5154 from mozilla/bug-1392855-cliqz-funnelcake-experiment Bug 1392855 cliqz funnelcake experiment

Commits pushed to master at https://github.com/mozmeao/www-config https://github.com/mozmeao/www-config/commit/68941b5a8537a85fd802bb824f5d2a27db219511 [bug 1392855] Enable Cliqz funnelcake experiment on stage https://github.com/mozmeao/www-config/commit/d9cab1973189130cacc56d0c038c22f3eef06476 Merge pull request #43 from alexgibson/cliqz-funnelcake-experiment [bug 1392855] Enable Cliqz funnelcake experiment on stage

Reopening this while we test / verify on stage

Commits pushed to master at https://github.com/mozilla/bedrock https://github.com/mozilla/bedrock/commit/30cab2a6f1eacffb1caea15a8d84642de2b4c213 [bug 1392855] Add firstrun lang file to Cliqz funnelcake experiment pages https://github.com/mozilla/bedrock/commit/1adfbed452be2c5a6d4398893fe3dcb6d2d571fb Merge pull request #5184 from alexgibson/bug-1392855-fix-cliqz-lang-file [bug 1392855] Add firstrun lang file to Cliqz funnelcake experiment pages

Ok, things to test on staging: 1.) Verify that all /new funnelcake URLs are working correctly, and giving the appropriate funnelcake build upon download on Windows: https://www.allizom.org/de/firefox/new/?f=119 https://www.allizom.org/de/firefox/new/?f=120 https://www.allizom.org/de/firefox/new/?f=121 (cliqz privacy policy) https://www.allizom.org/de/firefox/new/?f=122 (cliqz privacy policy) 2.) Verify that /firstrun funnelcake pages look correct: https://www.allizom.org/de/firefox/56.0/firstrun/?f=119 (control) https://www.allizom.org/de/firefox/56.0/firstrun/?f=120 (firefox template) https://www.allizom.org/de/firefox/56.0/firstrun/?f=121 (cliqz template) https://www.allizom.org/de/firefox/56.0/firstrun/?f=122 (cliqz template) 3.) Someone geo-located in Germany needs to hit the folowing URL and verify they are entered (redirected) into one of the 4 funnelcakes above. They need to use a non Firefox browser on Windows. Make sure do-not-track is not enabled: https://www.allizom.org/de/firefox/new/ Once all this has been verified, we can enable the test in production on Monday

non technical comments in a technical bug. restricting comments to editbugs users.

This bug was accidentally closed, opening back to publicly viewable

Commits pushed to master at https://github.com/mozmeao/www-config https://github.com/mozmeao/www-config/commit/e30a72b9ffbfc83f17cff597ee02041bc08dae6d [bug 1392855] Enable Cliqz funnelcake experiment on prod. https://github.com/mozmeao/www-config/commit/8406916f299217cf904d8dd1efeb51d3b39901ce Merge pull request #47 from jpetto/bug-1392855-cliqz-funnelcake-experiment-prod [bug 1392855] Enable Cliqz funnelcake experiment on prod.

Commits pushed to master at https://github.com/mozmeao/www-config https://github.com/mozmeao/www-config/commit/03c0fca308e0321eaf120ee87f08fad9621aab65 [fix bug 1392855] Remove Cliqz funnelcake config https://github.com/mozmeao/www-config/commit/eb98f086e224ef5923f1c90e878c091319a4f477 Merge pull request #70 from jpetto/bug-1392855-remove-cliqz-funnelcake-config [fix bug 1392855] Remove Cliqz funnelcake config