Skip to content
This repository has been archived by the owner on Dec 23, 2019. It is now read-only.

As a member of the site team, I want to measure whether the IA is successfully meeting user needs so that we can make changes if necessary #109

Open
5 of 8 tasks
jenniferthibault opened this issue Sep 11, 2018 · 7 comments
Assignees
Milestone

Comments

@jenniferthibault
Copy link
Contributor

jenniferthibault commented Sep 11, 2018

Since we are having trouble recruiting card sort and tree test users, we are looking for other ways of measuring success of the site IA, including possibly a site intercept, as seen on GSA.gov. This will help gather feedback for the next round of changes, (or next phase of work, if it comes too late).

Tasks

Any specific steps or tasks we want to make sure to do

  • Research how we get access to an intercept tool
  • Secure access to intercept tool
  • Decide what logic will trigger the intercept
  • Determine if an automated response report can be setup to track feedback
  • Write content framing feedback
  • Implement intercept logic on the production site

Acceptance criteria

Acceptance criteria define when a work item is complete and working as expected.

  • We are able to get feedback on the site's IA asynchronously
  • Feedback is collected, stored and accessible either from a table or an auto generated report
@jdamis4XD
Copy link
Contributor

jdamis4XD commented Sep 13, 2018

Need to follow up with Lauren Ancona about the feasibility of using Recruiter. An inquiry was sent to Katherine Spivey, but she yet to provide any feedback.

@jdamis4XD
Copy link
Contributor

jdamis4XD commented Sep 13, 2018

staging site: https://federalist-proxy.app.cloud.gov/preview/18f/cic-site/108-WhyCloudOverview/

Survey fields:
1a- [1-5 rating] How would you rate the site navigation menus?
1b- [ If rated 1-2, display 1b] How would you have liked to see the navigation organized?
2a- [Y/N] Were you able to find the content you needed on the site?
2b- [If No, display 2b] Was there any content missing you expected to find on the site?
3 - [Open ended] Is there anything else you want to share?

Intercept meta data collection:

  • Page user on
  • Session time
  • Page they exited the site

Intercept behavior: modal window

Intercept trigger logic:

  • Been on the site for 90 seconds or more
  • Not on an overview view page

@jdamis4XD
Copy link
Contributor

Met with Lauren and Ryan in order to launch next week if the site will not be available to the public than we don't have to be PRA compliant and can have more 3- 5 questions. If PRA compliance is required, than we will be limited to a generic open ended question, like the https://www.farmers.gov/. @lauraGgit will the MVP site be accessible to the public?

@jdamis4XD
Copy link
Contributor

@lauraGgit Lauren Ancona provided the following Google Snippet and instructions on how to add to the site:

// Add the below snippet in

<script>(function(w,d,s,l,i){w[l]=w[l]||[];w[l].push({'gtm.start': new Date().getTime(),event:'gtm.js'});var f=d.getElementsByTagName(s)[0], j=d.createElement(s),dl=l!='dataLayer'?'&l='+l:'';j.async=true;j.src= 'https://www.googletagmanager.com/gtm.js?id='+i+dl;f.parentNode.insertBefore(j,f); })(window,document,'script','dataLayer','GTM-PJCSB98');</script>

// Add the below snippet as high in as possible

<iframe src="https://www.googletagmanager.com/ns.html?id=GTM-PJCSB98" height="0" width="0" style="display:none;visibility:hidden"></iframe>

@jdamis4XD jdamis4XD reopened this Sep 21, 2018
@jdamis4XD
Copy link
Contributor

jdamis4XD commented Sep 21, 2018

@lauraGgit Lauren will need to be informed once the code is added to test on her end and deploy. If a question needs to be edited we will need to let Lauren know who will need a day or two to implement.

@jenniferthibault
Copy link
Contributor Author

jenniferthibault commented Sep 24, 2018

Quick question on this — even though the site isn't "public" as in, connected from GSA and marketed/promoted, it's still publicly findable. Can't tell from the thread here, but did the content in this comment change based on that access?

@jdamis4XD
Copy link
Contributor

We are going to have two branches, one that is password protected and will have the survey and another that is public facing with no survey.

Final questions are:
Survey fields (password protected site):
1- [1-5 rating] How would you rate the site navigation menus?
2- [ Open ended] Are there any improvements you would like to see of how navigation is organized? (Please explain)
3- [Y/N] Were you able to find the content you needed on the site?
4 - [Open ended] Is there anything else you want to share?

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants