Async SOQL. salesforce Big Objects

PDF

سند

تبلیغات

CHAPTER 2 Async SOQL

In this chapter ...

•

•

•

Async SOQL is a method for running SOQL queries when you can’t wait for the results in real time. These queries are run in the background over Salesforce entity data, standard objects, custom objects, and big objects. It provides a convenient way to query large amounts of data stored in Salesforce.

EDITIONS

Available in: Enterprise,

Performance, Unlimited, and Developer Editions

Async SOQL is implemented as a RESTful API that enables you to run queries in the familiar syntax of SOQL. Because of its asynchronous operation, you can subset, join, and create more complex queries and not be subject to timeout limits. This situation is ideal when you have millions or billions of records and need more performant processing than is possible using synchronous SOQL. The results of each query are deposited into an object you specify, which can be a standard object, custom object, or big object.

Note: Async SOQL for standard and custom objects is in Pilot.

You can run multiple queries in the background and monitor their completion status. The limit for Async

SOQL queries is two concurrent queries, and a maximum of 10 in a 24-hour period.

Async SOQL Versus SOQL

SOQL and Async SOQL provide many of the same capabilities. So when would you use an Async SOQL query instead of standard SOQL?

Use standard SOQL when:

•

You want to display the results in the UI without having the user wait for results.

•

You want results returned immediately for manipulation within a block of Apex code.

•

You know that the query will return a small amount of data.

Use Async SOQL when:

•

You are querying against millions of records.

•

You want to ensure that your query completes.

•

You do not need to do aggregate queries or filtering outside of the index.

Async SOQL

For example, let’s say that you want to analyze the years and years of opportunity history collected by

Salesforce. The results could help you identify which current and future opportunities are more likely to close and give you a better picture of your forecast. But because the opportunity history data is stored with all the field history data across the application, the volume of data is too large to query directly.

That’s where Async SOQL comes in! You can use it to write a query that extracts a smaller, representative subset of the data that you’re interested. You can store this working dataset in a custom object and use it in reports, dashboards, or any other Force.com feature.

With big objects, you can now bring a much finer level of detail into your applications using data that you already have. For example, every interaction an individual has with your marketing campaign is stored as data that you can use, but it’s unwieldy in its raw form. With Async SOQL, you can aggregate that data by campaign and day, allowing you to extract the relevant details of the full dataset into a

Async SOQL smaller, usable dataset. As in the previous example, the smaller working set can live in a custom object and be used in your reports and dashboards.

Async SOQL Running Async SOQL Queries

Running Async SOQL Queries

Learn how to run Async SOQL queries on your objects and check on the status of your query using the Chatter REST API.

Formulating Your Async SOQL Query

To use Async SOQL effectively, it’s helpful to understand its key component and other related concepts. Each query is formulated in the

POST request as a JSON-encoded list of three or four key-value pairs.

Request body for POST

Name Type

query operation

String

String targetObject

String targetFieldMap

Map<String,

String>

Description Required or

Optional

Required Specifies the parameters for the SOQL query you want to execute.

Specify whether the query is an insert or upsert. If the record doesn’t exist, an upsert behaves like an insert.

Optional

Note: Upsert is not supported for big objects

A standard object, custom object, external object, or big object into which to insert the results of the query.

Required

Defines how to map the fields in the query result to the fields in the target object.

Required

Note: When defining the targetFieldMap

parameter, make sure that the field type mappings are consistent. If the source and target fields don’t match, these considerations apply.

•

Any source field can be mapped onto a target text field.

•

If the source and target fields are both numerical, the target field must have the same or greater number of decimal places than the source field. If not, the request fails. This behavior is to ensure that no data is lost in the conversion.

•

If a field in the query result is mapped more than once, even if mapped to different fields in the target object, only the last mapping is used.

Available

Version

35.0

39.0

35.0

Async SOQL Running Async SOQL Queries

Name Type

targetValueMap

Map<String,

String> targetExternalIdField

String

Description Required or

Optional

Defines how to map static strings to fields in the target object. Any field or alias can be used as the

TargetValueMap

value in the SELECT clause of a query.

You can map the special value, $JOB_ID, to a field in the target object. The target field must be a lookup to the Background Operation standard object. In this case, the ID of the Background

Operation object representing the Async SOQL query is inserted. If the target field is a text field, it must be at least 15–18 characters long.

Optional

You can also include any field or alias in the SELECT clause of the

TargetValueMap

. They can be combined together to concatenate a value to be used.

The ID of the target sObject. Required for upsert operations.

Optional

Available

Version

37.0

39.0

This simple Async SOQL example queries

SourceObject__c

, a source custom object, and directs the result to

TargetObject__c

, another custom object. You can easily map the fields in the source object to the fields of the target object in which you want to write the results.

Example URI

https://yourInstance.salesforce.com/services/data/v38.0/async-queries/

Example POST request body

{

"query": "SELECT firstField__c, secondField__c FROM SourceObject__c",

"operation": "insert",

"targetObject": "TargetObject__c",

"targetFieldMap": {"firstField__c":"firstFieldTarget__c",

"secondField__c":"secondFieldTarget__c"

"targetValueMap": {"$JOB_ID":"BackgroundOperationLookup__c",

"Copy fields from source to target":"BackgroundOperationDescription__c"

}

The response of an Async SOQL query includes the elements of the initial POST request.

Response body for POST

Async SOQL Running Async SOQL Queries

Property Name

jobId message operation

Type

String

Description Filter Group and

Version

The ID of the Async SOQL query. This ID corresponds to an entry in the Background

Operation standard object. It matches the

ID that is used in the targetValueMap when $JOB_ID is used. To get the status of an async query job, use this ID in an Async

Query, Status request

(

/async-queries/

jobId

Big, 35.0

Available Version

35.0

A text message that provides information regarding the query, such as an error message if the query failed.

Big, 37.0

Specify whether the query is an insert or upsert. If the record doesn’t exist, an upsert behaves like an insert.

Big, 39.0

Note: Upsert is not supported for big objects

37.0

.39.0

35.0

query status

String

Specifies the parameters for the SOQL query you want to execute.

Big, 35.0

Status of an async query job.

•

Canceled

—The job was canceled before it could be run.

•

Success

—The job was successfully completed.

•

Failed

—The job failed after the system submitted it or because the request exceeded the Async SOQL limits. The message field provides details on the reason for failure.

•

Running

—The job is running successfully, and the org hasn’t exceeded any limits.

•

Scheduled

—The new job has been created and scheduled, but is not yet running.

Big, 35.0

targetExternalIdField

String The ID of the target sObject. Required for upsert operations.

Big, 39.0

targetFieldMap

Map<String, String> Defines how to map the fields in the query result to the fields in the target object.

Big, 35.0

Note: When defining the targetFieldMap

parameter,

35.0

39.0

35.0

Async SOQL Running Async SOQL Queries

Property Name Type Description Filter Group and

Version

Available Version

make sure that the field type mappings are consistent. If the source and target fields don’t match, these considerations apply.

•

Any source field can be mapped onto a target text field.

•

If a field in the query result is mapped more than once, even if mapped to different fields in the target object, only the last mapping is used.

targetValueMap

Map<String, String> Defines how to map static strings to fields in the target object. Any field or alias can be used as the

TargetValueMap

value in the SELECT clause of a query.

Big, 37.0

You can map the special value, $JOB_ID, to a field in the target object. The target field must be a lookup to the Background

Operation standard object. In this case, the

ID of the Background Operation object representing the Async SOQL query is inserted. If the target field is a text field, it must be at least 15–18 characters long.

You can also include any field or alias in the

SELECT clause of the

TargetValueMap

They can be combined together to concatenate a value to be used.

targetObject

String A standard object, custom object, external object, or big object into which to insert the results of the query.

Big, 35.0

37.0

35.0

Async SOQL Running Async SOQL Queries

Example POST response body

{

"jobId": "08PD000000003kiT",

"message": "",

"query": "SELECT firstField__c, secondField__c FROM SourceObject__c",

"status": "New",

"targetObject": "TargetObject__c",

"targetFieldMap": {"firstField__c":"firstFieldTarget__c",

"secondField__c":"secondFieldTarget__c"

"targetValueMap": {"$JOB_ID":"BackgroundOperationLookup__c",

"Copy fields from source to target":"BackgroundOperationDescription__c"

}

Tracking the Status of Your Query

To track the status of a query, specify its jobID with an HTTP GET request.

https://yourInstance.salesforce.com/services/data/v38.0/async-queries/<jobID>

The response is similar to the initial POST response but with updated status and message fields to reflect the status.

Example GET response body

{

"jobId": "08PD000000000001",

"message": "",

"query": "SELECT firstField__c, secondField__c FROM SourceObject__c",

"status": "Complete",

"targetObject": "TargetObject__c",

"targetFieldMap": {"firstField__c":"firstFieldTarget__c",

"secondField__c":"secondFieldTarget__c" }

}

You can get status information for all queries with the following HTTP GET request.

https://yourInstance.salesforce.com/services/data/v38.0/async-queries/

Example GET response body

{

"asyncQueries" : [ {

"jobId" : "08PD00000000002",

"message" : "",

"query" : "SELECT String__c FROM test__b",

"status" : "Running",

Async SOQL Async SOQL Use Cases

"targetFieldMap" : {

"String__c" : "String__c"

"targetObject" : "test__b",

"targetValueMap" : { }

}, {

"jobId": "08PD000000000001",

"message": "Complete",

"query": "SELECT firstField__c, secondField__c FROM SourceObject__c",

"status": "Complete",

"targetObject": "TargetObject__c",

}

"targetFieldMap": {"firstField__c":"firstFieldTarget__c",

"secondField__c":"secondFieldTarget__c" }

Canceling a Query

You can cancel a query using an HTTP DELETE request by specifying its jobId.

https://yourInstance.salesforce.com/services/data/v38.0/async-queries/jobId

Note: Canceling a query that has already completed has no effect.

Handling Errors in Async SOQL Queries

Two different types of errors can occur during the execution of an Async SOQL query.

•

An error in the query execution

•

One or more errors writing the results into the target object

Problems in executing the job cause some errors. For example, an invalid query was submitted, one of the Async SOQL limits was exceeded, or the query caused a problem with the underlying infrastructure. For these errors, the response body includes a status of

Failed. The message parameter provides more information on the cause of the failure.

Other times, the query executes successfully but encounters an error while attempting to write the results to the target object. Because of the volume of data involved, capturing every error is inefficient. Instead, subsets of the errors generated are captured and made available. Those errors are captured in the BackgroundOperationResult object and retained for seven days. You can query this object with the Async SOQL query jobID to filter the errors for the specific Async SOQL query. Async SOQL job info is retained for a year.

Async SOQL Use Cases

Understand some of the common Async SOQL use cases.

Customer 360 Degree and Filtering

In this use case, administrators load various customer engagement data from external sources into Salesforce big objects and then process the data to enrich customer profiles in Salesforce. The goal is to store customer transactions and interactions, such as point-of-sale data, orders, and line items in big objects and then process and correlate that data with your core CRM data. Anchoring customer

Async SOQL Async SOQL Use Cases transactions and interactions with core master data provides a richer 360-degree view that translates into an enhanced customer experience.

The following example analyzes the customer data stored in the Rider record of a car-sharing service. The source big object, Rider_Record_b, has a lookup relationship with the Contact object, allowing for an enriched view of the contact’s riding history. You can see that the query includes Rider__r.FirstName, Rider__r.LastName, Rider__r.Email as part of the

SELECT

clause. This example demonstrates the ability to join big object data (Rider_Record__b) with Contact data (FirstName, LastName, Email) in a single Async SOQL query.

Example URI

https://yourInstance—api.salesforce.com/services/data/v38.0/async-queries/

Example POST request body

{

"query": "SELECT End_Location_Lat__c, End_Location_Lon__c, End_Time__c,

Start_Location_Lat__c, Start_Location_Lon__c, Start_Time__c,

Car_Type__c, Rider__r.FirstName, Rider__r.LastName,

Rider__r.Email

FROM Rider_Record__b WHERE Star_Rating__c = '5'",

"targetObject": "Rider_Reduced__b",

"targetFieldMap": {"End_Location_Lat__c":"End_Lat__c",

"End_Location_Lon__c":"End_Long__c",

"Start_Location_Lat__c": "Start_Lat__c",

"Start_Location_Lon__c": "Start_Long__c",

"End_Time__c": "End_Time__c",

"Start_Time__c": "Start_Time__c",

"Car_Type__c": "Car_Type__c",

"Rider__r.FirstName": "First_Name__c",

}

"Rider__r.LastName": "Last_Name__c",

"Rider__r.Email": "Rider_Email__c"

}

Example POST response body

{

"jobId": "08PB000000000NA",

"message": "",

"query": "SELECT End_Location_Lat__c, End_Location_Lon__c, End_Time__c,

Start_Location_Lat__c, Start_Location_Lon__c, Start_Time__c,

Car_Type__c, Rider__r.FirstName, Rider__r.LastName,

Rider__r.Email

FROM Rider_Record__b WHERE Star_Rating__c = '5'",

"status": "New",

"targetFieldMap": {"End_Location_Lat__c":"End_Lat__c",

"End_Location_Lon__c":"End_Long__c",

"Start_Location_Lat__c": "Start_Lat__c",

"Start_Location_Lon__c": "Start_Long__c",

"End_Time__c": "End_Time__c",

Async SOQL Async SOQL Use Cases

}

"Start_Time__c": "Start_Time__c",

"Car_Type__c": "Car_Type__c",

"Rider__r.FirstName": "First_Name__c",

"Rider__r.LastName": "Last_Name__c",

"Rider__r.Email": "Rider_Email__c"

"targetObject": "Rider_Reduced__b"

Field Audit Trail

Field Audit Trail lets you define a policy to retain archived field history data up to 10 years, independent of field history tracking. This feature helps you comply with industry regulations related to audit capability and data retention.

You define a Field Audit Trail policy using the

HistoryRetentionPolicy

object for each object you want to archive. The field history data for that object is then moved from the History related list into the

FieldHistoryArchive

object at periodic intervals, as specified by the policy. For more information, see the Field Audit Trail Implementation Guide .

You can use Async SOQL to query archived fields stored in the

FieldHistoryArchive

object. You can use the

WHERE

clause to filter the query by specifying comparison expressions for the

FieldHistoryType

ParentId

, and

CreatedDate

fields, as long as you specify them in that order.

This example queries archived accounts created within the last month.

Example URI

https://yourInstance.salesforce.com/services/data/v38.0/async-queries/

Example POST request body

{

"query": "SELECT ParentId, FieldHistoryType, Field, Id, NewValue, OldValue

FROM FieldHistoryArchive WHERE FieldHistoryType = ‘Account’

AND CreatedDate > LAST_MONTH”,

"targetObject": "ArchivedAccounts__b",

"targetFieldMap": {"ParentId": "ParentId__c",

"FieldHistoryType": "FieldHistoryType__c",

"Field": "Field__c",

"Id": "Id__c",

"NewValue": "NewValue__c",

}

"OldValue": "OldValue__c"

}

Example POST response body

{

"jobId": "07PB000000006PN",

"message": "",

"query": "SELECT ParentId, FieldHistoryType, Field, Id, NewValue, OldValue

FROM FieldHistoryArchive WHERE FieldHistoryType = ‘Account’ AND CreatedDate

> LAST_MONTH”,

Async SOQL Async SOQL Use Cases

"status": "New",

"targetObject": "ArchivedAccounts__b",

"targetFieldMap": {"ParentId": "ParentId__c",

"targetObject": "Rider_Reduced__b" }

}

Note: All number fields returned from a SOQL query of archived objects are in standard notation, not scientific notation, as in the number fields in the entity history of standard objects.

Event Monitoring

Login Forensics and Data Leakage Detection, currently in pilot, enable you to track who is accessing confidential and sensitive data in your Salesforce org. You can view information about individual events or track trends in events to swiftly identify unusual behavior and safeguard your company’s data. This feature is useful for compliance with regulatory and audit requirements.

Note: These features are available to select customers through a pilot program. To be nominated to join this pilot program, contact salesforce.com.

In the current pilot, you can monitor data accessed through API calls, which covers many common scenarios because more than 50% of SOQL queries occur using the SOAP, REST, or Bulk APIs. Key information about each query, such as the Username, UserId, UserAgent, and SourceIP, is stored in the ApiEvent object. You can then run SOQL queries on this object to find out details of user activity in your org.

For example, let’s say you want to know everyone who viewed the contact record of your company’s CEO, Jane Doe. The key to this query is the CEO’s contact record ID: 003D000000QYVZ5. (You can also query the ID using SOQL:

SELECT Id FROM Contact

WHERE Name = 'Jane Doe'

). You can use the following Async SOQL query to determine all users who saw their contact information, including when, how, and where they saw it.

Example URI

https://yourInstance—api.salesforce.com/services/data/v38.0/async-queries/

Example POST request body

{

"query": "SELECT Soql, SourceIp, Username, EventTime FROM ApiEvent

WHERE RecordInfo Like '%003D000000QYVZ5%'",

"targetObject": "QueryEvents__c",

"targetFieldMap": {"Soql":"QueryString__c","SourceIp":"IPAddress__c",

"Username":"User__c", "EventTime":"EventTime__c",

"UserAgent":"UserAgent__c"

}

Example POST response body

{

"jobId": "05PB000000001PQ",

"message": "",

"query": "SELECT Soql, SourceIp, Username, EventTime

FROM ApiEvent WHERE RecordInfo Like '%003D000000QYVZ5%'",

Async SOQL Async SOQL Use Cases

"status": "Complete",

"targetObject": "QueryEvents__c",

"targetFieldMap": {"Soql":"QueryString__c","SourceIp":"IPAddress__c",

"Username":"User__c", "EventTime":"EventTime__c", "UserAgent":"UserAgent__c"

}

Note: All number fields returned from a SOQL query of archived objects are in standard notation, not scientific notation, as in the number fields in the entity history of standard objects.

If you ask this question on a repeated basis for audit purposes, you can automate the query using a cURL script.

curl -H "Content-Type: application/json" -X POST -d

'{"query": "SELECT Soql, SourceIp, UserAgent, Username, EventTime FROM ApiEvent WHERE

RecordInfo Like'%003D000000QYVZ5%'","targetObject": "QueryEvents__c",

"targetFieldMap": {"Soql":"QueryString__c", "SourceIp":"IPAddress__c", "Username":"User__c",

"EventTime":"EventTime__c",UserAgent}}'

"https://

yourInstance

.salesforce.com/services/data/v35.0/async-queries" -H

"Authorization: Bearer 00D30000000V88A!ARYAQCZOCeABy29c3dNxRVtv433znH15gLWhLOUv7DVu.

uAGFhW9WMtGXCul6q.4xVQymfh4Cjxw4APbazT8bnIfxlRvUjDg"

Another event monitoring use case is to identify all users who accessed a sensitive field, such as Social Security Number or Email. For example, you can use the following Async SOQL query to determine the users who saw social security numbers and the records in which those numbers were exposed.

Example URI

https://yourInstance—api.salesforce.com/services/data/v38.0/async-queries/

Example POST request body

{

"query": "SELECT Soql, Username, RecordIds, EventTime FROM ApiEvent

WHERE Soql Like '%SSN__c%'",

"targetObject": "QueryEvents__c",

"targetFieldMap": {"Soql":"QueryString__c", "Username":"User__c",

}

"EventTime":"EventTime__c", "RecordIds":"Records_Seen__c"

}

Example POST response body

{

"jobId": "08PB000000001RS",

"message": "",

"query": "SELECT Soql, Username, RecordIds, EventTime FROM ApiEvent

WHERE Soql Like '%SSN__c%'",

"status": "Complete",

"targetFieldMap": {"Soql":"QueryString__c", "Username":"User__c",

Async SOQL Supported SOQL Commands

"EventTime":"EventTime__c", "RecordIds":"Records_Seen__c"

}

"targetObject": "QueryEvents__c"

Supported SOQL Commands

Async SOQL supports a subset of commands in the SOQL language. The subset includes the most common commands that are relevant to key use cases.

Note:

For details of any command, refer to the SOQL documentation .

WHERE

Comparison operators

=, !=, <, <=, >, >=, LIKE

Logical operators

AND, OR

Date formats

YYYY-MM-DD, YYYY-MM-DDThh:mm:ss-hh:mm

Example

SELECT AnnualRevenue

FROM Account

WHERE NumberOfEmployees > 1000 AND ShippingState = ‘CA’

Date Functions

Date functions in Async SOQL queries allow you to group or filter data by time periods, such as day or hour.

Method

DAY_ONLY()

HOUR_IN_DAY()

CALENDAR_MONTH()

CALENDAR_YEAR()

Details

Returns a date representing the day portion of a dateTime field.

Returns a number representing the hour in the day for a dateTime field.

Returns a number representing the month for a dateTime field.

Returns the year for a dateTime field.

Example

SELECT DAY_ONLY(date__c), HOUR_IN_DAY(date__c), count(Id)

FROM FieldHistoryArchive

GROUP BY DAY_ONLY(date__c), HOUR_IN_DAY(date__c)

Async SOQL Supported SOQL Commands

Aggregate Functions

AVG(field), COUNT(field), COUNT_DISTINCT(field), SUM(field), MIN(field), MAX(field)

Note:

MIN()

and

MAX()

do not support picklists.

Example

SELECT COUNT(Id)

FROM FieldHistoryArchive

HAVING

Use this command to filter results from aggregate functions.

Example

SELECT LeadSource, COUNT(Name)

FROM Lead

GROUP BY LeadSource HAVING COUNT (Name) > 100

GROUP BY

Use this option to avoid iterating through individual query results. Specify a group of records instead of processing many individual records.

Example

SELECT COUNT(Id) count, CreatedById createdBy

FROM FieldHistoryArchive

GROUP BY CreatedById

Relationship Queries

Single-level child-to-parent relationships are supported using dot notation. Use these queries with the SELECT, WHERE, and GROUP BY clauses.

Example

SELECT Account.ShippingState s, COUNT(Id) c

FROM Contac

GROUP BY Account.ShippingState

Using Aliases with Aggregates

Examples

{"query":"SELECT count(Id) c, EventTime t FROM LoginEvent group by EventTime",

"targetObject":"QueryEvents__c",

Async SOQL

}

"targetFieldMap":{"c":"Count__c", "t" : "EventTime__c"}

{"query":"SELECT count(Id), EventTime FROM LoginEvent group by EventTime",

"targetObject":"QueryEvents__c",

}

"targetFieldMap":{"expr0":"Count__c","EventTime" : "EventTime__c"}

{"query":"SELECT count(Id ) c , firstField__c f FROM SourceObject__c",

}

"targetObject":"TargetObject__c",

"targetFieldMap":{"c":"countTarget__c","f":"secondFieldTarget__c"}

Supported SOQL Commands

سلام! من یک ربات چت هوش مصنوعی هستم که به طور خاص برای کمک به شما در مورد Async SOQL. salesforce Big Objects آموزش دیده‌ام. من سند را به طور کامل بررسی کرده‌ام و می‌توانم به شما کمک کنم اطلاعات دقیقی را که نیاز دارید پیدا کنید یا محتوا را به زبان ساده و واضح توضیح دهم. چه به دنبال راهنمایی در مورد ویژگی‌های خاص، مراحل عیب‌یابی یا استفاده عمومی باشید، می‌توانید سوالات خود را بپرسید. هرچه جزئیات بیشتری در مورد نگرانی‌ها یا نیازهای خود ارائه دهید، من می‌توانم دقیق‌تر و موثرتر به شما کمک کنم!

دستیار در حال تایپ

دستیار از صفحه کلید خارج شده است. لطفا بعدا دوباره امتحان کنید.

فهرست مطالب

به نظر می‌رسد به سندی رسیده‌اید که به چندین زبان نوشته شده است، از جمله زبانی که زبان مادری شما نیست. می‌توانید از پیوندهای زیر برای پنهان کردن موقت صفحاتی که زبان مورد نظر شما را ندارند استفاده کنید.