Table of Contents
Endorsements
Summary Report | Data Elements View | Performance View
Data Dictionary Report
Web API Report
Notifications | Sending Notifications | Notification Tracking
Canceling Certification
Revoking Certification
Archiving Endorsements | Auto-Archiving
My Account | Creating a Token
Admin Actions | Creating an Admin User | Creating a Provider User | Creating a Normal User | UOI Syncing
Admin FAQ
Endorsements
Data providers (e.g., MLS vendors) must submit their certification tests through the self-testing user interface and then notify their customers (e.g., MLSs) to review and approve the results. The customer will then review the results and approve them to receive their certification for the given endorsement.
At this time, there are two possible endorsements that can be issued to data providers, Data Dictionary 1.7 and Web API Core 2.0.0, each of which have different reports.
For data providers certifying MLS recipients, Web API Core 2.0.0 or Web API Core 2.1.0 must be passed for at least one MLS prior to testing for Data Dictionary.
See more information about viewing Endorsements.
Summary Report
Each Summary Report shows information about the resources, fields and lookups that were found on the server for the organization.
Each report contains two views, Data Elements and Performance, accessed from a dropdown at the top of the page.
Data Elements View
The Data Elements view shows the field and lookup counts and how they compare to industry averages. The counts are broken down by Advertised and Available data.
Advertised: the data elements that were found in the server metadata
Available: the data elements that were found in the payload during sampling
The Availability Threshold slider sets minimum data availability that each field and lookup in the data set must be greater than or equal to. The default availability threshold level shows the count of data elements with availability greater than zero.
The Resources dropdown beneath the chart filters the data to the specific resource selected.
Performance View
The Performance view shows the server performance metrics for the provider.
Note: Providers may opt out of displaying server metrics publicly when sending the notification to the recipient. If opted out, the performance metrics will be visible only to the provider, recipient and RESO admin staff.
Performance Metrics
Performance is measured on:
- Payload Size - how much data was retrieved when sampling the selected resource. “All” represents the average across all resources found, measured in megabytes (MB).
- Response Time - how long, on average, a request to the given server took to complete, measured in seconds (s).
- Throughput - the payload size divided by response time. Similar to an Internet speed test, this metric shows how quickly consumers might expect to retrieve data from the given server. Measured in megabytes per second (MB/s).
N/A - means that the given recipient has not completed Data Dictionary availability testing yet.
Estimated Seconds per 1,000 Records - the estimated time it takes to retrieve 1,000 records from the server. Shows for the specific provider and industry average.
Providers may reach out to certification@reso.org if they have further questions.
Data Dictionary Report
The Data Dictionary Report provides a way to explore the data elements of the server submitted for RESO certification. See more information about Exploring the Data Dictionary Report.
Web API Report
IMPORTANT: All MLS providers are required to obtain the Web API Core Endorsement prior to that of the Data Dictionary.
For example, select View Details at the right of the Web API Core 2.0.0 Endorsement to view the report.
The Web API Core report displays the name of the organization that was tested and the name of the data provider.
The report shows which version of OData the RESO Web API Server was using and the authentication type, with the current options being OAuth 2 Bearer Token or Client Credentials. The fields that were used for testing and the status button are also shown.
Data providers (e.g., MLSs) can be notified of the availability of their Web API Report for certification approval by selecting the Passed button at the top right of this page. See more information about sending Notifications.
Notifications
Certification testing results must be reviewed and approved by recipients before they are certified. The review requests are sent via email.
When providers select Passed and then Notify Recipient for either the Data Dictionary or the Web API Core report, a bundled review notification for both endorsements is sent to the recipient. The recipient will be able to review and approve both results from a single link that directs them to the Certification Summary page.
Note: The bundled notification is only available when both Data Dictionary and Web API are in Passed status. Otherwise, the email will only include the single endorsement that was selected for notification.
IMPORTANT: Providers should not send a notification to any other party except the organization they are certifying. Any recipient of the email would have the ability to approve the results.
Sending Notifications
Providers may select the Passed button from the endorsements page or any report page, then select Notify Recipient.
They then select whether to Accept or Opt-Out of having the performance metrics displayed publicly and select Next.
The email entry screen confirms which endorsements will be included in the email. Providers enter the recipient’s email address and select Send Now.
An email with a link to the results will be sent to the recipient for review and approval. The button will then change from Passed to Notified.
Once the customer has approved the results, the button will change to Certified.
Notification Tracking
Providers are allowed to send a maximum of two notifications for each recipient.
If a notification has previously been sent, the notification count and recipient email address will appear when the Notified button is selected.
See Admin FAQ for troubleshooting notification issues.
Canceling Certification
Providers may cancel the certification process for endorsements in Passed or Notified status.
Select the Passed or Notified button, then select Cancel Certification.
A confirmation of the cancelation is sent to the provider. The recipient is not notified of a cancel action.
The endorsement will now show as Canceled and may be archived (see below).
See Admin FAQ for scenarios around canceling certification.
Revoking Certification
RESO staff may revoke certifications under certain conditions and should consult with Josh Darnell prior to doing so.
See Admin FAQ for scenarios around revoking certification.
Archiving Endorsements
Providers may now archive endorsements and should do so for any organizations that they are no longer serving or contain results that are otherwise unwanted.
Archiving is available for endorsements in Passed, Notified, Certified, Canceled or Withdrawn status.
Select the status button on the endorsement to be archived and select Archive.
A notification of the archive action will be sent to the provider. The recipient is not notified.
See Admin FAQ for scenarios around archiving endorsements.
Auto-Archiving
Certification endorsements are automatically archived and replaced if a new endorsement of the same type is initiated by the provider.
Auto-archiving will occur for endorsements in Passed, Notified, Canceled or Withdrawn status.
Endorsements in a permanent status (Certified, Revoked) will remain alongside the new endorsements. The old endorsements may be manually archived by the provider at any time.
My Account
Selecting My Account at the top of the page displays user information and the ability to copy or create a new token hash.
Creating a Token
Providers may create a token in order to access the certification data via Web API with the steps below.
Log in to certification.reso.org with your username and password.
Select My Account from the top toolbar.
Select the Create Token button.
The token will then be displayed along with options to copy it to the clipboard or to delete it (in the case of multiple tokens).
Admin Actions
Creating an Admin User
Admins may create new admin users by selecting the Admin Actions button from the top toolbar.
Select the Create User button under the Admins section.
Create a username and password.
Enter a full name and email address, then select Save.
Creating a Provider User
Select Create User under the Users section.
Select the Provider User radio button.
Create a username and password.
Select the organization for the provider.
Enter a full name and email address, then select Save.
Creating a Normal User
Select Create User under the Users section.
Select the Normal User radio button.
Create a username and password.
Enter a full name and email address, then select Save.
UOI Syncing
Currently, organization records are populated on the certification site by syncing from an internal spreadsheet containing Unique Organization Identifier (UOI) details.
See the UOI Sync Process.
Admin FAQ
Notifications
How many notifications can a provider send to their recipient (customer)?
Two notifications, partly due to spam concerns.
What if a provider has used their maximum number of two notifications?
Providers should be encouraged to reach out to their customers directly through other methods. RESO staff may provide the original notification emails through copies of the email or the certification-alerts Slack channel to providers to relay to their customers, including date sent, destination email address and the original sender (i.e., certification@reso.org).
What if the provider reports that their customer cannot locate the notification emails?
Confirm the recipient’s email address with the recipient, copy the “magic link” used to review results from the original notification emails and send it directly to the recipient with instructions that the link is sensitive and not to be shared. Here is a sample email:
Greetings,
The most recent notification email was sent to [recipient email address] on [date] and came from certification@reso.org. The email contains a link to review and approve your certification endorsements. If you are unable to locate the email, the following link may be used to access and approve the results:
[paste magic link here]
Note: This is a sensitive link akin to a password and should not be shared outside of the appropriate staff at your organization.
Help with viewing and approving the certification endorsements may be found here.
Archiving Endorsements
Why would an admin need to archive an endorsement?
- A recipient organization is disabled in the UOI sheet as the result of a merger
- A recipient organization is disabled as a result of nonpayment
- A nonmember organization purchases a single use report and then goes defunct (inactive)
What statuses may be archived by an admin?
All Statuses: Passed, Notified, Certified, Canceled, Revoked or Withdrawn.
Canceling Certification
Can RESO staff cancel a certification at the request of a recipient?
Recipients should be directed to their provider for requests regarding cancelation.
What if a recipient asks why their certification was canceled?
Recipients should be directed to their provider for the reason.
Revoking Certification
Why would an admin revoke a certification?
A certified provider or recipient may be found to be out of compliance in practice. The provider should be contacted and informed of the compliance issue.
Can a provider revoke certification?
No, Revoke is a RESO admin-only function.
Recipient Organization Mergers
Do certified organizations that merge to create a new organization need to retest?
Yes, the new organization will need to retest regardless of the statuses of the organizations that comprise it.