Unlock Your Team’s Full Potential with My Insights and Team Insights

CAMILLE CHEONG: Welcome to Autodesk University's "Unlock your team's full potential with My Insights and Team Insights" section. I'm your speaker today, Camille Cheong. I'm a Product Manager in Insights Analytics within Autodesk.

BRIAN SOUDER: And I'm Brian Souder. I'm the Senior Principal Data Strategist for the My Insights team that has built what you're going to be looking at today.

CAMILLE CHEONG: Before we proceed, I would like to share our Safe Harbor Statement as we will be making forward-looking information regarding future developments in the presentation, we want you to be aware that the presentation is, by no means, a promise for or guarantee for development. So let's dive into learning more about Insights.

Why are Insights important? Before we explain what it is about, I want you to know that Insights is about presenting information that is targeted specific to your user or your team. The information is provided on an ongoing basis, that information is actionable that will allow you to have a recommendation action. Contextual, in the sense that there will be visualization that helps you understand the information or data behind Insights. And lastly, data presented behind Insights should be reflecting the current or timely behavior.

Broadly speaking, Insights can be classified into four themes. Number one, subscription management. Two, learning new skills. Three, machine performance. And four, productivity.

These four types of Insights are applicable to two personas-- End-User and Team Admin. On the end-user side, the focus are around learning new skills. For example, what are the new commands that an AutoCAD end user has not been aware of and can adopt to his or her project? Machine performance is around how the end user can identify performance issues and perhaps identify updates to install to improve the performance. And lastly, productivity, it's taking learning to a whole different level. For example, and users might want to know how to automate their workflow to improve productivity.

On the Team Admin side, team admins manage a team of end users, and they always are questions-- they have questions around how can they manage their subscriptions and license purchases better. For example, licenses that have not been active for a while, they can use the Insights to understand what users should be moved to select token consumption model. Similarly for end user, learning new skills and machine performance issue areas will allow the team admin to help their teams work more efficiently. I'll now hand off to Brian to talk about My Insights.

BRIAN SOUDER: Thanks, Camille. So to get started here, we're going to talk about how Insights work, and we're going to kind of take a look at some examples. With Insights, we're really starting with the way a user is using the product. And specifically, Autodesk in My Insights is interested in the series of commands a given user is using.

Those commands flow from the machine itself into Autodesk. And once they get here, the commands are aggregated together, for example, with the company information, the usage history-- not only which commands, but the sequences of the commands-- what types of products you have. And all of this is brought together into an anonymous profile for each user.

From there, that information is fed into the My Insights engine. There are a number of pieces there. For example, a decision engine runs. There's various machine learning algorithms running and a publishing engine. And once all of that is done, an Insight is produced. Well, actually, multiple Insights are produced for each given user.

So let's dive a little deeper into some examples. I'll start with command recommendations. This is a very popular Insight, and you'll start to see how and why. So the question that we ask ourselves is, how can we intelligently highlight commands that users might want to learn next? And so we've got a number of users here on screen. And their usage data pours into the My Insights information engine, or this My Insights creation engine.

And a simple way to think about this is, every user has a row of information in this giant spreadsheet. And each column is every command in the product. That information is in that large array, and it's then sorted and organized so that the like users are organized together.

So everyone who's very heavily involved in editing and dimensioning, they might organize together. And why that's important is because, for each user, then, we calculate the commands that a given user might want to learn next by looking at their peers, looking at their closest neighbors in this organizational structure. This is very similar to how the Netflix recommender works, and it's really an effective way for us to understand new types of commands and recommend new types of commands that you might want to learn.

So in this case, this target user is the highest score, which was MEASUREGEOM. That was the functionality that was being used by the closest peers. And we would then of course, make a recommendation for MEASUREGEOM for that given user.

Let's take a look at another example. Macro Recommendation is a newer Insight. And what it does is it builds a custom recommendation for a user based on exactly the sequence of commands they're using. And this happens in near real time. So let me describe how that works.

So all of the users are here in this data set. The command sequences, or the session data, is then evaluated. And so that's really about the sequence of commands that are used in order.

Now, those sequences are evaluated both by a machine learning algorithm and also an AutoCAD expert. And what's happened there is, once we look at all of these sequences, we start to identify and pick out good macros that could be developed in any given sequence. So in this particular case, we see that all of these are there.

We would then look at any given user and start to highlight via the score the types of sequences that are going to be important for that user. From then, you will see that-- and I'll show you a demo of this in a minute-- the user, as they're working, when they get close and actually do that sequence, we then pop up, in real time, the recommendation, and we deliver a macro for that user. So you'll see that in just a second.

I've shown you two Insight types so far. We have a number of them. I'll talk very briefly about eight. But in reality, there are actually more than that-- so these two macro recommendations and command recommendations.

We also have Usage By Category, and that shows how you're using and what you're using, each given user at this point in time. So for the last 30 days, these are the commands and the categories of commands that you're using. The Drawing Statistics themselves-- so how big your drawings are or, what might you do in order to improve how the drawing is performing?

Have You Tried articles or very popular at Autodesk. And in the case with My Insights, we only highlight the Have You Tried articles that we know you're not currently doing. So different Have You Tried articles talk about different functionality. If you're already using that functionality, then we have no need to highlight it for you.

Efficiency Booster-- it looks like another report, but it's a little different. So for example, in this particular case, you can see that, on Efficiency Booster, it's highlighting Erase, and Hatch, and Fillet. The reason we're highlighting that is because this particular user is using those commands very often, but they're not using the keyboard alias. And so therefore, they're sort of losing an opportunity. So we highlight the keyboard aliases for your most common commands so that you can work more quickly.

App Performance highlights things in how your machine is performing in relationship to your peers or the larger customer base. So you can see if your machine is performing slowly or quickly. And last of all, Update Recommendation-- again, we know what commands you're using.

We know which versions you're currently on. And so when we talk to any given user about an update, we would highlight the functionality in that new update that might be important to you. So as you can see, these are all very custom for each given user.

Now, in the upper right-hand corner, I will highlight the fact that My Insights are available for AutoCAD users at this point in time that are on the Single-User Subscription model. We'll talk more about that as we go forward today. So now I'm going to turn it over to Camille again.

CAMILLE CHEONG: Thanks, Brian. So now let's take a deep dive into one of Team Insights' use cases. For those of you who are team admins, especially has a role in monitoring the machine performance of your teams, you might be wondering all the time how your team's-- which user's machine is experiencing performance issue. This is especially important to get the information for us. Companies are becoming more distributed, and users, employees, are working in a remote setting.

In this example, this team has a total of seven users. The Machine Performance Insights tell us the admin amounts their team members, which one is experiencing slower, average, and faster than average, which is Autodesk AutoCAD user population benchmark. This Insight, it's parsed the number of users using a percentile statistical approach. Admins can also use the Export to drill into which users falls under each of these categories.

In addition to Machine Performance Insights, there are other team Insights available today to admins on the Single-User Subscription plan. Learning productivity, as I mentioned before, helps admins understand the learning patterns of their end user. In this example, this shows the average command use by category for AutoCAD for a specific team.

The other Team Insights are related to Subscription Management. For example, Under-Assigned User Insight tells admins how many seats they have available that have not been assigned. The call to action is to help admins assign these seats so that Autodesk can help you optimize your license's utilization.

Product Version Insight is available to our Single-User Subscription Premium customers today. Admins can see which of their users or the number of users are on a particular outlier version. What we've heard from customer is that product version combat compatibility is a top-of-mind topic for them.

Identifying the number of users that should be upgraded or downgraded to a more compatible version help admins optimize performance. Inactive User-- it's another premium Insight that helped our admins identify licenses that have been inactive for a long period of time, so that can be reassigned to other users who are in need. I'm going to hand off back to Bryan to talk about delivery of these Insights.

BRIAN SOUDER: Thanks, Camille. So now I'd like to talk about how we deliver the Insights to all of the end users. The My Insights email is currently our most population distribution mechanism. We send out these emails about once a month. And as you can tell, customers that have used the product actively and we are generating more than a few Insights, they will get this email each month.

The next most common way is in the Autodesk Account area. So we produce this, and it's updated about once a week. So you can go here at any time and see all of the latest Insights.

In the last version and the point release before, we now are producing the AutoCAD Home area. When you go to AutoCAD Home, again, about once a week or so, we update the Insights that are presented there. So you have three different locations where you can go and see the My Insight page.

Now, the other area I'm going to talk about is on the Macro Advisor. And this one is different because the macros are delivered directly inside of AutoCAD. So if you look at the command line at the lower left side, you'll see that the user is typing. In this case, it was purge, and then zoom, and then save. Now, those three are actually a sequence in which we have a macro available.

As soon as that user clicks that third item, because we're monitoring this in real time, we deliver the custom-generated macro directly to the product. If the user clicks that new suggested macro, they can immediately try it. They can save it. They can edit it.

So what's important here is that we're delivering it not at a random time. We're delivering it just after the user completed that sequence. So that's an important thing to keep in mind, and it really starts to highlight what we think are going to become a more impactful way of delivering Insights. These are these Automation Insights. So now I'll turn it back over to Camille, and she can talk about customer reactions.

CAMILLE CHEONG: Thanks, Brian. So we are right now in year two of the Insights program since 2021. We have received a lot of really good feedback as well as quantitative data to prove the success of this program. Over 900,000 users have been able to receive both Team Insights and My Insights. Specifically, for end users who receive Macro Advisor Insights, we have been able to reach over 40,000 of the AutoCAD end users.

Overall, our Insights usefulness score has been hitting our benchmark. Specifically for top Insights, the usefulness score is around 86%, which is really great. And lastly, for our team admins, we have been able to generate and send Insights to over 70,000 teams.

In addition to quantitative data, we've heard good feedback from our customers as well. On the end user side, the majority of the good comments were related to how Insights have been able to help them discover new features as well as to improve their product proficiency for AutoCAD. A lot of the AutoCAD end users are already experts in the field.

These Insights help them uncover something that they might or might not have known already. For our team admins, they've also found the Subscription Management Insights very useful in helping them meet their Subscription Management objectives. Brian, I'll hand it off to you to talk about what's next.

BRIAN SOUDER: So there's a number of areas that I'm going to talk about here. And that is that the first one is this usage reporting. You saw that a second ago.

We had the little pie chart type diagram. This is new this is the expanded usage reporting with a drill down. So you can see here on this screen the percentage of time people are spending in different areas.

But as you drill in, you can actually see a lot more. Now, I'm going to actually jump out of my slides for a second and show you what that actually looks like. So here, I'm in a prototype, and you're seeing that this particular user has spent 29% of their time inside of object modification.

So every user will get a report like this. And then you can open these up, and you can see all of the commands they're using. So they're using 18 commands actively for 29% of their time. And you can hover over each of these.

Now, the other important thing is this little REC for Recommendation. And you can see that, again, the command recommending capability is encouraging this user to try this move, copy, rotate express tool function. I'll just click through.

And you can see also the darker. That means they use them a lot more. And it gets lighter and lighter, which using them less. And you can see that we have Core functionality, Occasional functionality, and Rare functionality.

So I'll just go down through. So this user is using 29% Object Modification. We look maybe at Object Control. We can open that up. And you can see, again, that this user is, of course, going to use undo, and line type, and various things here.

So we believe that these things, along with the feature recommendation, is going to be really helpful. A lot of our customers ask for this type of stuff. And we're very excited to be able to deliver it.

Next, I'll talk about CER. Now, this is one of my pet projects. I actually was Product Manager for CER for a number of years. And so this is now-- we're going to actually combine or integrate the CER program with My Insights.

So what this is going to be like, for example, as you know with CER, when an Autodesk developer produces an update, then that update gets delivered out to our users, either in real time when the user stumbles across a problem, or later when an update is fixed. Now, today, that round trip is-- that's what we call it-- but that notification only happens for a small percentage of our users that actually provide an email address. And so a lot of our users don't provide email addresses when sending in CERs.

So what this is going to allow us to do is, users are going to be able to receive the CER round-trip notifications inside of Insights. And for teams, this is going to provide a lot of crossteam visibility to enable admins to make informed decisions about when to roll out updates. And I've already mentioned, of course, that this is not dependent on email address.

This is a big one. So a lot of Revit users have been asking, where is their Insights? So we're happy to say that in the hopefully near future, you're going to start to get your My Insights for Revit. There's a number of prototype ones here on the screen. Early indications suggest that this is going to be very, very powerful, and so we're very excited about this here in the My Insights team.

And there's one team Insight that I'm going to let Camille talk to.

CAMILLE CHEONG: Yep. The Team Insights with User Detail release is going to be an exciting development for our Standard plan admins. As some of you might have heard from other AU sessions, Autodesk will be providing usage reporting for a Single-User Subscription Standard customers with user details and more granular information.

This feature will be extended to Insights as well. Starting in October, admins can go into Autodesk Account and click the Export button to download an Excel file of specific information related to the Insights for their teams and be able to identify exactly which user on the team this Insight is eligible for. For example, a team performance or machine performance Insight, you'll be able to see which specific user is experiencing slower, average, or faster performance time and specific average performance time for each of the users.

So now you have seen all of the exciting features that the Insights program have to offer. We would love to have you join the community and provide us with additional feedback on how to further improve and how you are reacting to the existing Insights. There's a QR code on screen, and feel free to scan it and sign up to be part of our Research Community. Thank you, everyone.

BRIAN SOUDER: Thank you.