Live Face Swap

Generated resources (images, videos) are valid for 7 days. Please save related resources promptly to prevent expiration.

Overview

Live Face Swap API provides real-time face swap functionality, supporting real-time face swap operations during live streaming.

Get Access Token

Before calling other APIs, you need to obtain an access token first.

POST https://openapi.akool.com/api/open/v3/getToken

Request Headers

Parameter	Value	Description
Content-Type	application/json	Request content type

Request Body

Parameter	Type	Description
clientId	String	Client ID
clientSecret	String	Client secret

Example Request

{
    "clientId": "AKX5brZQ***XBQSk=",
    "clientSecret": "tcMhvgV0fY***WQ2eIoEY70rNi"
}

Face Detection

Detect faces in media files (image, video, or GIF) and get facial landmarks, face regions, and cropped face URLs.

POST https://openapi.akool.com/interface/detect-api/detect_faces

Request Headers

Parameter	Value	Description
x-api-key	API Key	Your API Key used for request authorization. If both Authorization and x-api-key have values, Authorization will be used first and x-api-key will be discarded.
Authorization	Bearer `{token}`	Your API Key used for request authorization.Get Token.
Content-Type	application/json	Request content type

Request Body

Parameter	Type	Description
url	String	Media URL for face detection (supports image, video, and GIF)
single_face	Boolean	Whether to detect single face only
return_face_url	Boolean	Whether to return the cropped face URL
num_frames	Integer	Number of frames to detect for videos (maximum 24 frames)

Example Request

{
    "url": "https://d21ksh0k4smeql.cloudfront.net/1745579943557-yr5w-crop_1728989585247-3239-0-1728989585409-9277.png", // Supports image, video, and GIF formats
    "single_face": false,
    "return_face_url": true, // Whether to return the cropped face URL
    "num_frames": 10 // For videos, specify the number of frames to detect. Maximum supported is 24 frames.
}

Response

Parameter	Type	Description
error_code	int	Error code (0: success)
error_msg	String	Error message
faces_obj	Object	Object containing detected faces information, keyed by face index
↳ landmarks	Array	Facial landmarks coordinates array
↳ landmarks_str	Array	Facial landmarks coordinates string array
↳ region	Array	Face region coordinates
↳ frame_time	Float	Frame time in seconds (for video/gif)
↳ crop_region	Array	Cropped face region coordinates
↳ crop_landmarks	Array	Cropped facial landmarks coordinates string array
↳ face_urls	Array	URLs of the cropped face images

Response Example

{
    "error_code": 0,
    "error_msg": "SUCCESS",
    "faces_obj": {
        "0": {
            "landmarks": [
                [
                    [249, 510],
                    [460, 516],
                    [343, 657],
                    [351, 739],
                    [254, 739],
                    [449, 745]
                ]
            ],
            "landmarks_str": [
                "249,510:460,516:343,657:351,739"
            ],
            "region": [
                [150, 261, 437, 661]
            ],
            "frame_time": null,
            "crop_region": [
                [3, 0, 731, 1183]
            ],
            "crop_landmarks": [
                "246,510:457,516:340,657:348,739"
            ],
            "face_urls": [
                "https://d5v2vcqcwe9y5.cloudfront.net/algorithm/face_detect/expire_7days/260324/default/qvjssv8fna0o.jpg"
            ]
        }
    }
}

Create Real-time Face Swap Session

Create a new real-time face swap session.

POST https://openapi.akool.com/api/open/v3/faceswap/live/create

Request Headers

Parameter	Value	Description
x-api-key	API Key	Your API Key used for request authorization. If both Authorization and x-api-key have values, Authorization will be used first and x-api-key will be discarded.
Authorization	Bearer `{token}`	Your API Key used for request authorization.Get Token.
Content-Type	application/json	Request content type

Request Body

Parameter	Type	Description
sourceImage	Array	Source image information array, each element contains path and opts properties

Example Request

{
    "sourceImage": [
        {
            "path": "https://d21ksh0k4smeql.cloudfront.net/crop_1695201165222-7514-0-1695201165485-8149.png",
            "opts": "262,175:363,175:313,215:272,279"
        }
    ]
}

Response

Parameter	Type	Description
code	int	API response business status code (1000: success)
msg	String	API response status information
data	Object	Response data object

Response Example

{
    "code": 1000,
    "msg": "OK",
    "data": {
        "_id": "684f8fb744b8795862e45cbe",
        "faceswap_status": 1,
        "front_user_id": "1",
        "algorithm_user_id": "3",
        "front_rtc_token": "007eJxTYFj/uGvaue3C3/VlOLdFmM5UuffmzHGhszbnTSqs3or94HNRYEhNNElJM0oxMkg1MTYxMklMMkm0MDCySDW0sDBOMjRP297vnyHAx8Bw6YAZIyMDIwMLAyMDiM8EJpnBJAuYFGMwMjAyNTAzNDMwNrI0tTQ0MIy3MDIyYWQwBADtwSJM",
        "channel_id": "20250616032959101_8224",
        "app_id": ""
    }
}

Status Code Description

faceswap_status:
- 1: Queuing
- 2: Processing (when this value is 2, the frontend can connect to Agora’s server)
- 3: Success
- 4: Failed

Update Real-time Face Swap Session

Update existing real-time face swap session configuration.

POST https://openapi.akool.com/api/open/v3/faceswap/live/update

Request Headers

Parameter	Value	Description
x-api-key	API Key	Your API Key used for request authorization. If both Authorization and x-api-key have values, Authorization will be used first and x-api-key will be discarded.
Authorization	Bearer `{token}`	Your API Key used for request authorization.Get Token.
Content-Type	application/json	Request content type

Request Body

Parameter	Type	Description
_id	String	Session ID
sourceImage	Array	Source image information array, each element contains path and opts properties

Example Request

{
    "sourceImage": [
        {
            "path": "https://d21ksh0k4smeql.cloudfront.net/1745579943557-yr5w-crop_1728989585247-3239-0-1728989585409-9277.png",
            "opts": "249,510:460,515:343,657:255,740"
        }
    ],
    "_id": "685ea0bb5aa150dd8b7116b1"
}

Response Example

{
    "code": 1000,
    "msg": "OK"
}

Close Real-time Face Swap Session

Close the specified real-time face swap session.

POST https://openapi.akool.com/api/open/v3/faceswap/live/close

Request Headers

Parameter	Value	Description
x-api-key	API Key	Your API Key used for request authorization. If both Authorization and x-api-key have values, Authorization will be used first and x-api-key will be discarded.
Authorization	Bearer `{token}`	Your API Key used for request authorization.Get Token.
Content-Type	application/json	Request content type

Request Body

Parameter	Type	Description
_id	String	Session ID

Example Request

{
    "_id": "685ea0bb5aa150dd8b7116b1"
}

Response Example

{
    "code": 1000,
    "msg": "OK"
}

Code Examples

# Get token
curl -X POST "https://openapi.akool.com/api/open/v3/getToken" \
    -H "Content-Type: application/json" \
    -d '{
        "clientId": "AKX5brZQ***XBQSk=",
        "clientSecret": "tcMhvgV0fY***WQ2eIoEY70rNi"
    }'

# Face detection
curl -X POST "https://openapi.akool.com/interface/detect-api/detect_faces" \
    -H "x-api-key: {{API Key}}" \
    -H "Content-Type: application/json" \
    -d '{
        "single_face": false,
        "url": "https://d21ksh0k4smeql.cloudfront.net/1745579943557-yr5w-crop_1728989585247-3239-0-1728989585409-9277.png",
        "return_face_url": false
    }'

# Create session
curl -X POST "https://openapi.akool.com/api/open/v3/faceswap/live/create" \
    -H "x-api-key: {{API Key}}" \
    -H "Content-Type: application/json" \
    -d '{
        "sourceImage": [
            {
                "path": "https://d21ksh0k4smeql.cloudfront.net/crop_1695201165222-7514-0-1695201165485-8149.png",
                "opts": "262,175:363,175:313,215:272,279"
            }
        ]
    }'

# Update session
curl -X POST "https://openapi.akool.com/api/open/v3/faceswap/live/update" \
    -H "x-api-key: {{API Key}}" \
    -H "Content-Type: application/json" \
    -d '{
        "sourceImage": [
            {
                "path": "https://d21ksh0k4smeql.cloudfront.net/1745579943557-yr5w-crop_1728989585247-3239-0-1728989585409-9277.png",
                "opts": "249,510:460,515:343,657:255,740"
            }
        ],
        "_id": "685ea0bb5aa150dd8b7116b1"
    }'

# Close session
curl -X POST "https://openapi.akool.com/api/open/v3/faceswap/live/close" \
    -H "x-api-key: {{API Key}}" \
    -H "Content-Type: application/json" \
    -d '{
        "_id": "685ea0bb5aa150dd8b7116b1"
    }'

Response Code Description

Note: If the code value in the response is not 1000, the request has failed or is incorrect.

Parameter	Value	Description
code	1000	Success
code	1003	Parameter error or parameter cannot be empty
code	1101	Invalid authorization or the request token has expired
code	1102	Authorization cannot be empty
code	1104	Insufficient quota

Important Notes

Resource Validity: Generated resources are valid for 7 days, please save them promptly
Face Detection: Use the face-detect API to get face landmarks coordinates before creating face swap sessions
Status Monitoring: After creating a session, you need to monitor the faceswap_status status
Real-time Connection: When the status is 2, you can connect to Agora’s server for real-time face swap
Session Management: Please close sessions promptly after use to release resources
Error Handling: Please handle API error codes and error messages properly

Push and pull stream Demo References

For implementing real-time video communication with Agora SDK, you can refer to the following resources:

Basic Video Calling Demo Parameter Description

As shown in the figure above, channel_id, front_user_id, and front_rtc_token correspond to the Channel, User ID, and Token input fields on the page respectively. These parameters can be obtained after creating a session through the Live Face Swap API. After filling them in, you can experience push/pull streaming and real-time face swap effects.

Demo Page

Live Demo: https://webdemo-global.agora.io/example/basic/basicVideoCall/index.html

Source Code

GitHub Repository: https://github.com/AgoraIO/API-Examples-Web/tree/main/src/example/basic/basicVideoCall

Recommended Track Configuration

For optimal performance in live face swap scenarios, it’s recommended to use the following track configurations:

Audio Track Configuration

const audioTrack = await AgoraRTC.createMicrophoneAudioTrack({
  encoderConfig: "music_standard",
});

Video Track Configuration

const videoTrack = await AgoraRTC.createCameraVideoTrack({
  encoderConfig: {
    width: 640,
    height: 480,
    frameRate: {max: 20, min: 20},
    bitrateMin: 5000,
    bitrateMax: 5000,
  },
});

These configurations are optimized for:

Audio: Using music_standard encoder for better audio quality
Video: Fixed frame rate at 20fps with controlled bitrate for stable performance
Resolution: 640x480 resolution suitable for face swap processing

These resources provide complete examples of how to integrate Agora’s real-time video communication SDK, which can be used as a reference for implementing the video streaming part of the live face swap functionality.

Authentication

Face Swap

Streaming Avatar

Talking Photo

Video Translation

Face Detection

Character Swap

AI Tools Suite

Overview

Get Access Token

Face Detection

Create Real-time Face Swap Session

Update Real-time Face Swap Session

Close Real-time Face Swap Session

Code Examples

Response Code Description

Important Notes

Push and pull stream Demo References

Basic Video Calling Demo Parameter Description

Demo Page

Source Code

Recommended Track Configuration

Audio Track Configuration

Video Track Configuration

Authentication

Face Swap

Streaming Avatar

Talking Photo

Video Translation

Face Detection

Character Swap

AI Tools Suite

​Overview

​Get Access Token

​Face Detection

​Create Real-time Face Swap Session

​Update Real-time Face Swap Session

​Close Real-time Face Swap Session

​Code Examples

​Response Code Description

​Important Notes

​Push and pull stream Demo References

​Basic Video Calling Demo Parameter Description

​Demo Page

​Source Code

​Recommended Track Configuration

​Audio Track Configuration

​Video Track Configuration

Overview

Get Access Token

Face Detection

Create Real-time Face Swap Session

Update Real-time Face Swap Session

Close Real-time Face Swap Session

Code Examples

Response Code Description

Important Notes

Push and pull stream Demo References

Basic Video Calling Demo Parameter Description

Demo Page

Source Code

Recommended Track Configuration

Audio Track Configuration

Video Track Configuration