Webhook to send code for free trial

http://developers.marketo.com/documentation/webhooks/

If we use their ResponseMapping for WebHooks, you could have our license app post the required information to Marketo, and then retrieve it there. We would need to find out how to process this information inside Marketo.

@AshleyS My question is, why does the license email need to go through Marketo? Can't it be directly sent to the user from our license app?

@patricio what is our license app and how does it send notification emails?

I'll need some pings back to Marketo from our licensing app (I think) to do things like the following:

-begin_trial_date: Send a ping to Marketo when a user inputs their license code/activates license code. Not sure the proper terminology there.

-upgrade_date: Send a ping to Marketo when a trial user upgrades to enterprise.

-license_email_opened_date: Send a ping to Marketo when a new user opens the license email.

So I could do things like

If begin_trial_date>25 days and upgrade_date is empty, send email saying your trial expires in 5 days, would you like to speak to someone?

If license_email_opened_date is empty and form_trial_license was submitted greater than 10 days ago, send email reminding user to activate code.

@sytses @ChadMalchow

@AshleyS the license app is the server that takes care of generating a license for GitLab EE. It can send emails when a new license is created to the owner of the license. (The license is an encrypted file that needs to be uploaded into GitLab, it is not a code).

I see some problems with your requirements, however:

begin_trial_date: Send a ping to Marketo when a user inputs their license code/activates license code. Not sure the proper terminology there.

The license is valid for a fixed period of time, it does not start the moment it is uploaded, it starts on a given date at the moment of creation.

upgrade_date: Send a ping to Marketo when a trial user upgrades to enterprise.

I'm not sure how feasible this is, specially on environments that don't allow their servers to access the internet. Code for this ping would have to be implemented in GitLab EE itself.

-license_email_opened_date: Send a ping to Marketo when a new user opens the license email.

For this to work, the license has to be sent by Marketo. It might work with the WebHook type I mentioned before.

/cc @DouweM @JobV

Note that right now, all subscription management takes place in Recurly, which posts a webhook to the license app, which will then generate a license file based on the information in Recurly and send that out to the user. The license app is only responsible for generating license files, not for managing other aspects of subscriptions.

I'm not quite sure what we're trying to accomplish here, but it seems to me like it would make more sense to hook up Marketo to Recurly rather than the license app.

I'm also not quite sure if www-gitlab-com is the appropriate project for this issue, it sounds more like something for https://dev.gitlab.org/gitlab/organization.

@DouweM @JobV @patricio

Questions:

would it be possible for marketo to post a webhook to the license app triggering the sending of a license file via email?
what format is the license file?
Is it possible to send that license file to marketo via API or webhook?

Requirements:

We need to use the marketo form so we can remove the restriction from recurly of requiring an email
We need to make sure the user is notified once they've submitted the free trial form (form is hosted by marketo)
We do not want to require a credit card to get a free trial so the recurly form can't be used.

@AshleyS:

would it be possible for marketo to post a webhook to the license app triggering the sending of a license file via email?

Yes, as long as we have the time of subscription, start date, end date, name, company and email.

what format is the license file?

It's a .gitlab_license file which contains plaintext-encoded encrypted data, representing the license details, that the GitLab EE app knows how to decrypt.

Is it possible to send that license file to marketo via API or webhook?

If their API/webhooks allow that, sure.

We need to use the marketo form so we can remove the restriction from recurly of requiring an email

Why do we not want to require an email?

@DouweM I misspoke. I meant we do not want to require a credit card. apologies!

@AshleyS Ah, that makes more sense :)

Putting everything we talked about in person here in notes:

The license app should send the text license file to Marketo via webhook upon form submit. The email with the license file will be sent from Marketo. Who can work with me to complete this? @sytses @DouweM @JobV

Change file on website to be a Marketo form:
Work with webhooks to move data into marketo: http://developers.marketo.com/documentation/webhooks/
Send email via Marketo API as transactional email. http://developers.marketo.com/blog/sending-transactional-emails-with-the-marketo-rest-api-part-1/

Reassigned to @DouweM

@DouweM Can you help with this?

@AshleyS Do you have experience with sending emails from Marketo that include files that have been uploaded to Marketo from elsewhere? The documentation is very confusing, but I think we'd need to use the Create a File API rather than Webhooks, although I'm not quite sure how to connect this to a person/organization in Marketo or how to get at this file from the email.

@DouweM I can help with the getting the file, email setup. I'll setup a tester field and blank email for this and re-ping this thread shortly.

When the user submits the form (embed code below), he or she will become a lead in Marketo automatically. The license key should then be generated and somehow attached to the Marketo email (link below). The automation is already setup for the user to receive the email from Marketo post-form fill. I've created a transactional email (no design yet) that will bypass unsubscribes with the {{lead.Trial License Key}} embedded into the email. I just need the license key sent into Marketo upon submit. You can do lookup on the submitted form on email to associate the key with the user.

If @DouweM is going to send the key file as an attachment, I'm clueless there on how to do.

marketo field name = {{lead.Trial License Key}}

email = https://app-ab13.marketo.com/#EM1240A1LA1 (ping me if you want a marketo account)

@rspeicher form code below

<script src="//app-ab13.marketo.com/js/forms2/js/forms2.min.js"></script>
<form id="mktoForm_1041"></form>
<script>MktoForms2.loadForm("//app-ab13.marketo.com", "194-VVC-221", 1041);</script>

How can i help to push this along?

I believe the blocker right now is how to send the license key, right, @DouweM?

@AshleyS You can ace my exam for me on Friday and save me two days of studying ;)

Getting the license key into Marketo is indeed the blocker right now, but from my initial reading of the docs it didn't seem obvious how to do this and I haven't had time yet to investigate further.

I would love to take your exam for you. Ping us when you have free time.

Good luck!

Milestone changed to Marketing

can we schedule a call with marketo's technical team to get this completed some time this week or early next? @DouweM what days are you working?

CC @rspeicher

@AshleyS I'm working next week, in CEST, on Monday from 1-5pm, Tuesday from 9am-1pm, Wednesday and Thursday from 1-6pm and all of Friday. I will have time to look into the issue myself on Monday.

Sounds good. Let me know how I can help. @rspeicher has been working with Marketo a lot and understand most things if you need clarification on how it handles webhooks, REST API, etc.

@DouweM @AshleyS This probably wouldn't be a webhook thing - REST API usually seems better for this (from devs I've worked with before on pulling data into Marketo).

The correct API name of the field is "trialLicenseKey". You can't make a call for "Trial License Key" because that's just a label for the field.

Here's the REST API docs (sorry if redundant): http://developers.marketo.com/documentation/custom-api/

@hanktaylor Agreed. ~~I made a simple app to handle #427 (closed) and I think I will just add a second thing to it to handle this case as well.~~

Edit: I was thinking of the Recurly hook. Maybe this will be a third thing!

I just had another look at the API, and I think this is what we're looking for:

Create Custom Objects to create a custom "GitLab License Key" object/attribute on an account
Email Scripting to include this custom object in the email body
Sending an email using the API

It does not look like it's possible to add an attachment to a Marketo email using Email Scripting.

GitLab Enterprise Edition does not currently support entering (or copy/pasting) a key manually, it requires it to be an uploaded file.

If we added the option to GitLab to enter a key manually, we'd be most of the way there. If this is really necessary, we should be able to get this into 8.2 at the last moment (it's a very minor change, code wise)

@AshleyS The call later today may end up being very short.

@DouweM thank you for looking into this. let's confirm it all w/ our technical contact at marketo as it is too late to cancel. If the call it short, more time for naps!

I will create a trigger campaign Smart list: fills out form Flow: Call web hook; Send email containing licenseKey

@hanktaylor Let me know when you want me to do what on the license app side.

@DouweM @rspeicher All I need is for the licenseKey to be sent to Marketo as a string to the Trial License Key field (API name is "trialLicenseKey"). Here's where all the webhook stuff is in Marketo: https://app-ab13.marketo.com/#WH0A1

Once that is being loaded into Marketo, I can automate the email to send the key to the user.

status?

@AshleyS status = "I'm working tomorrow and will tackle it then!"

:D

I've made changed in GitLab EE (gitlab-org/gitlab-ee!63), the license app (dev) and the license app chef cookbook (dev).

I've created a LicenseAppWebhook webhook in Marketo, but for some reason I am unable to set up the Response Mappings. We would want one from license_key to trialLicenseKey. For this reason, I have also not been able to actually test that the webhook ends up at the license app as expected.

@DouweM I edited LicenseAppWebhook to add the response mapping you wanted. Please check. Don't think I did anything special, not sure why you weren't able to.

Also feel free to remove the GetLicenseWebhook hook that the Marketo guy created as a demo if you no longer need it as reference.

All right, the license app is all set up, and the LicenseAppWebhook should work now, provided the tokens used actually exist and are set correctly.

@hanktaylor Can I help with anything else or can you take it from here?

One last thing: For Recurly licenses, we show the Recurly subscription ID in the license app so we can quickly see where this license originated. Is there a unique lead ID or something in Marketo? I didn't see one in the list of tokens.

@DouweM that's AWESOME.

@hanktaylor and @rspeicher can work together to get the forms switched out, get email setup to send the token, and integrate to SFDC.

Thanks all

@DouweM Does this help you get the lead ID? http://developers.marketo.com/documentation/rest/get-lead-by-id/

@rspeicher Here is the form embed code:

<script src="//app-ab13.marketo.com/js/forms2/js/forms2.min.js"></script>
<form id="mktoForm_1100"></form>
<script>MktoForms2.loadForm("//app-ab13.marketo.com", "194-VVC-221", 1100);</script>

I set up the email to send the key, so hopefully it will work immediately.

!1169 (merged) adds the form page.

So close!

@DouweM We tested the form and the webhook failed. Double click here to see the error: https://app-ab13.marketo.com/#SC1618E5 Is that enough for you to resolve?

Also, I fixed the company name token in the webhook. I changed it from {{lead.Inferred Company}} to {{company.company name}} so it will be fine now. For future reference, inferred data is based off IP address; inferred company is the company which has that IP registered i.e. almost always an ISP except at large companies.

@hanktaylor All right, I think I fixed it. Can you try again?

@DouweM I just tried it again, now it's throwing a 422. See the same page @hanktaylor linked above.

@rspeicher Company name is required right now, should this not be the case?

@DouweM Hmm, when I submitted it I filled out all fields, including company name, because they're required on the form.

@hanktaylor It looks like maybe the mapping is wrong? I know you changed it from inferred company.

mentioned in merge request !1169 (merged)

Ping @hanktaylor - see previous note.

looked in marketo - @hanktaylor is this the enterprise trial form of the wf_trial form?

@AshleyS No, it's in the Enterprise Trial program - https://app-ab13.marketo.com/#FO1100A1ZN13LA1

@rspeicher I swapped the token from {{lead.inferred company}} to {{company.company name}} - no other change was made.

@DouweM @rspeicher I just did a manual run of the webhook - it sent without error this time, but no key was returned. See test if you like: https://app-ab13.marketo.com/#SC1670E5

@hanktaylor I justed tested the endpoint again by sending a manual request, and everything seems to be in order. Is there a way to get more logs for the request Marketo sent? In the link, I only see "Response Code: 1000", which doesn't sound like an HTTP response code.

I enter a company:

The webhook fails because of an empty company:

No trial key:

I looked and it is mapped properly. @hanktaylor am I missing a setting? Will you double check.

@DouweM looks like our manual pushes return response code 1000 because they are manual: https://nation.marketo.com/message/22701#22701

So that's not helpful...

The other error we're getting is "server returned code 422" and there are no resources on that code I could find :/ Could that be from the license key app?

And everything looks mapped correctly to me, too @AshleyS

The webhook setup is here: https://app-ab13.marketo.com/#WH0A1

@hanktaylor I believe the 422 error is because the company name passed to the license app via the webhook is blank, even though it's filled in on the form.

@rspeicher that might be it - the form had "company" (labeled "company name") and I switched it to "company name". Try it now fingers crossed

@hanktaylor Success! Check Slack.

Glad that worked! Frustrating that Marketo has multiple company fields...

@hanktaylor confirming that we are ready to go. is email formatted correctly and round robin setup for sales team?

By email I mean the email that goes from Marketo to the user with the license key. Sorry for not being more clear. @hanktaylor

@hanktaylor I tested it just now and noticed the email formatting was still wrong, so I fixed it:

I also re-formatted the text-only version so that the key has line breaks around it as well.

We still need to change "Getting Started" to "Documentation" in both versions of the email.

@hanktaylor I also noticed the "Company Name" field is no longer required on the form, but AFAIK the license app still requires it. Did you add a fallback if the user doesn't fill out that field?

Make it live? @hanktaylor @rspeicher

yes

It's live! I think we can close this now.

Reassigned to @AshleyS

Status changed to closed

Mentioned in commit pfjason/gitlab-ce@80a12e64

Webhook to send code for free trial

Designs

Child items ...

Activity

Admin message

Admin message

Webhook to send code for free trial

Activity