Design Accessories
for Smartphones and Tablets
FTF-CON-F0128
Rudan Bettelheim | Business Development Manager
APR.2014
TM
External Use
Agenda
•
•
•
•
•
•
•
•
Introduction
Made For iPod (MFi) Accessories
Tower Development and Rapid Prototyping system
Android Accessories
Accessory Demos and Examples
Freescale Audio Solution
Summary
Q & A and Demos
TM
External Use
1
Introduction
TM
External Use
2
Smartphone and Tablet Accessories & Audio Applications
Accessories
Home Automation
Sport Equipment
Exercise Equipment
Home Health
Instrumentation
Input Devices
Automotive
Medical
POS/POT
Tools
Toys
Audio Processors
Pro/Prosumer Audio
Audio Docks
Headphones
Car Adaptors
Microphones
Mixers
Note: Accessories refers to
MFi, Android, Win, other?
TM
External Use
3
Audio
Gaming Headsets
Audio Processors
Networked Speakers
Receivers
Headphones
Distributed Audio
Pro/Prosumer Audio
Mixers
Telephony
Made For iPod (MFi) Accessories
TM
External Use
4
Made For iPod (MFi) Program
To develop Accessories or App-based accessories for iPhone®,
iPad® or iPod® devices, a company needs an MFi
(Made For iPod) license from Apple
TM
External Use
5
https://developer.apple.com/programs/mfi/
TM
External Use
6
MFi Accessory Connection Options
Wired
Wireless
Connection
Lightning
30-pin
BLE
BT
BT (MFi)
WiFi
MFi License
Required
Yes
Yes
No
No
Yes
Yes
Audio
Digital
Analog and
Digital
No
Yes
Yes
AirPlay
Supports all
MFi functions
Some MFi
functions not
supported
Wearables,
Home
Automation,
iBeacon
A2DP audio,
Handsfree
MFi BT
Connection,
Gaming
controllers
Streaming
audio
Notes/
Comments
TM
External Use
7
Freescale MFi Solution Philosophy
•
Develop a flexible solution supporting the full range of possible
accessories, including but not limited to audio
•
Develop a solution supporting a wide range of existing Freescale MCU
and MPU products, and capable of rapidly supporting new Freescale MCU
and MPU products at introduction
•
Architect the MFi solution to enable fast adoption of any MFi program
software or hardware updates
•
Make the Freescale MFi solution available to all eligible MFi licensees on
the MFi portal
TM
External Use
8
Made For iPod (MFi) Freescale Solutions
•
Freescale’s TWR-DOCK2, TWR-DOCK and supporting MFi software allow
the Tower System to be used for, iPhone, iPad and iPod Accessory and
App-based Accessory development and rapid prototyping, supporting the
Lightning and 30-pin dock connectors
−
•
This provided MFi development support for most MCU and MPU products
supported by the Tower System
Utilize TWR-DOCK2 components and software to support Freescale MPU
products not supported by the Tower System
TM
External Use
9
TWR-DOCK2 Tower ModuleConfiguration
Only
Jumpers
Custom Dock connector
cable Header
USB A Receptacle for
standard USB A to dock
connector cable
Analog stereo
headphones/headset
(3.5mm)
Analog stereo audio
line in (3.5mm)
Analog stereo audio
line out (3.5mm)
SGTL5000
Audio Codec
Signal Access Header
Tower System power
current limit circuit
(limiter set to 1A)
Orderable part number ($199):
MFI-FS-TWR-DOCK2
TM
External Use
10
External power
supply input
(minimum 5V 5A)
Device charge
current limit circuit
(limiter set to 2.5A~2.8A)
TWR-DOCK2 Use Examples
iPhone, iPad or iPod connected to Tower system
via TWR-DOCK2 and custom Lightning or 30pin connector cable
TM
External Use
11
Custom 30-pin connector cable
(USB and Serial connection)
Custom Lightning
connector cable
TWR-DOCK2 Custom Cables
Custom 30-pin connector cable
(USB and Serial connection)
•
•
•
•
•
Custom Lightning
connector cable
The TWR-DOCK2 custom cables use a JAE DD 40-pin connector to connect to the
TWR-DOCK2 module
The 40-pin connector supports all currently required signals, and allows for possible
future expansion
The set of TWR-DOCK2 custom cables support all currently available wired connection
options to iPhone, iPad, and iPod devices
The set of TWR-DOCK2 custom cables support all current iPhone, iPad, and iPod
device charging specifications
The set of TWR-DOCK2 custom cables supports the development of device power
accessories
Orderable part number ($199): MFI-FS-TWR-DOCK2-CBL
TM
External Use
12
Freescale’s Made For iPod (MFi) Solutions
Freescale’s MFi solutions are based on the TWR-DOCK2 and TWR-DOCK peripheral modules
TWR-DOCK2
•
•
•
•
•
•
TWR-DOCK
Custom cables supporting all Lightning and 30-pin dock
connector options for smart accessories
USB A receptacle for standard USB to Lightning™ and to
30-pin dock connector cables
Digital audio streaming in both directions over USB
Includes SGTL5000 hardware audio codec for analog
audio input and output
Control and communication with various devices
Available only on MFi Portal for $199, custom dock
connector cable set sold separately for $199
•
•
•
•
•
•
•
•
•
•
Direct 30-pin dock connection
USB A receptacle for standard USB to Lightning™ and
to 30-pin dock connector cables
Analog audio and video signals with standard RCA and
S-Video connectors
Digital audio streaming in both directions over USB
(requires hardware audio codec module like TWRAUDIO-SGTL or TWR-AUDIO-DA7321)
Control and communication with various devices
Available only on MFi Portal for $139
Includes free interface software Kinetis K and Kinetis L MCU families
May be used with a wide range of Tower System MCU/MPU, peripheral, sensor and communication modules
Example demos are available
i.MX and Vybrid support planned for mid 2014
TM
External Use
13
Kinetis KL26 MFi Audio Interface (MFI-KL26-AI) Module
Audio Interface Module for iPhone, iPad, and iPod devices with Apple Lightning™ connector
The MFI-KL26-AI provides line level analog audio input and output with
basic playback control and charging for iPhone, iPad, and iPod devices
with Apple Lightning dock connectors. It may be used as a reference
design or basic development system.
•
•
Kinetis KL26 MCU pre-programmed with MFi and Audio Playback
control software
Connectivity;
−
−
−
−
−
−
−
•
On/
Standby
•
Capacitive touch pads, configured for playback control
Standard configuration;
−
Repeat
•
−
•
TOP View
TM
External Use
14
Analog line audio input and output with Dialog DA7212 audio codec
Build options;
−
Shuffle
Lighting dock connector
USB A receptacle for use with standard USB to Lighting cables
− Note: Physical design prevents simultaneous use of above dock
connector options
3.5mm analog audio line output
3.5mm analog audio line input
Barrel receptacle for 6 to 12V power supply
Auxiliary header for serial, GPIO and power lines access
Debug interface header for use with Kinetis L MCU development tools
Analog line audio input and output with AKM AK4954A audio codec
FM modulated analog audio output with Quintic QN8007B FM
transmitter
Charging current for connected device is limited to 2.4A
Side View
MFI-KL26-AI Module
Lightning
USB A
6V~12V DC
Power input
Line in
Kinetis KL26 MCU
pre-programmed
with MFi and
Playback control
software
Line out
Dialog DA7212
Audio codec
Auxiliary header
Debugger header
On/
Standby
Planned versions:
1. MFI-KL26-AI-DA: Analog line audio with Dialog codec
2. MFI-KL26-AI-AKM: Analog line audio with AKM codec
3. MFI-KL26-AI-FM: FM modulated analog audio
TM
External Use
15
Repeat
Shuffle
Control capacitive
touch pads
Freescale MFi Software
iOS App
Speaker
Dock
MFi Interface Software
(Examples)
Accessory
Software
EKG
Sensor
System
GUI
Actuator
System
Accessory
MCU Firmware
Update
Altimeter
Digital Audio
Processing
EKG
Others
Accessory
MCU Firmware
Update
Altimeter
Lightning
30-pin
MFi Interface
Software
RTOS
No RTOS (“Bare Metal”)
MQX
Linux
Kinetis L, Kinetis K
Kinetis K, Vybrid
Vybrid, i.MX
I2C
Driver
Low Level
USB
Stack
MCU
Hardware
I2C
USB
TCP/IP
Stack
CPU
SD
Driver
DSP
DMA
External Use
16
Serial
Drivers
Memory
T
M
Ethernet
SD
Dock Connector
TM
I/O
Drivers
UART
I2S
Audio
Drivers
HW Codec/Class-D/
FM Modulator
I2S
Analog Audio
Freescale MFi Software Memory Requirements
Approximate Memory Requirement
Use Case (Kinetis MCU, no RTOS )
Flash (KB)
RAM (KB)
All MFi Functions and Features
100
17
Digital Audio Playback for Lightning and 30-pin devices
80
16
Digital Audio Playback for Lightning iOS devices
45
14
Non-Audio Accessory using the standard USB to Lightning
or 30-pin connector cables
70
11
Non-Audio Accessory using standard USB to Lightning
connector cable for iOS devices
40
9
Non-Audio Accessory using built in Lightning and 30-pin
dock connectors
45
8
Non-Audio Accessory using built in Lightning dock
connector for iOS devices
25
7
Note: The above are approximate typical memory requirements, actual memory needs will vary depending on the actual MFi
features and functions selected, compiler and optimization level used, and the size of user configurable buffers
TM
External Use
17
MFi Solutions Availability Plan
Software
Function and
OS
MCU/MPU
Family (CPU)
Kinetis L
MFi no OS
Kinetis K
Kinetis K
MFi MQX
(integrated in FAS)
Vybrid (M4)
Vybrid (A5)
MFi Linux
(integrated in FAS)
Vybrid (A5)
i.MX6
Development
Alpha
Beta
General
Availability
Q4-2013
Q1-2014
Q2-2014
Q3-2014
Q4-2014
l
l
l
l
l
l
l
l
l
l
l
l
l
l
l
l
l
l
l
l
l
l
Notes: Subject to change
TM
External Use
18
Accessory Firmware Update
Freescale MFi Software includes a function to
update Accessory MCU firmware via the iOS
App:
•
This supports secure method of Accessory MCU
firmware updates without the need for the
Accessory to include a network connection
App-Based
Accessory
Sensors
TM
External Use
19
App for
Accessory
Firmware Update
•
An App update may include the Accessory MCU
firmware update, which will be completed when
the iOS device is connected to the Accessory
with the App active
MCU
TWR-DOCK2
TWR-DOCK
App Accessory
Communication
Actuators
Freescale‘s MFi Demo Software
Demos:
•
Simple iPod control with digital audio– Now
• iPod control functions with GUI and digital audio – Now
• Digital audio streaming with optional post processing, and iOS App
control – Planned
• iOS App based EKG– Available with Lightning connector
• iOS App based Altimeter – Available with Lightning connector
What other demos would you like?
Devices:
•
TM
External Use
20
Tested with all iPhone, iPad, and iPod devices introduced since
2009
TWR-DOCK2 Freescale Web Page
For more information and the TWRDOCK Fact Sheet, visit:
http://www.freescale.com/mfi
Link to Apple MFi developer web page
TM
External Use
21
Tower System:
Development and Rapid
Prototyping
TM
External Use
22
The Freescale Tower System
MCU/MPU Module:
A modular development platform
for 8-/16-/32-bit MCUs & MPUs
−
Quickly combine Tower modules to
build a prototype of your application
−
Modules sold individually or in kits
−
Open Source: Build your own Tower
module to integrate your IP
−
Cost-optimized hardware
−
Software support from Freescale and
Third Parties
Primary
Elevator
−
Tower controller board
•
Standalone or in Tower System
Board
Connectors
Growing community of Third Party
hardware support
Secondary
Elevator
Peripheral Module:
•
−
•
•
Up to 3 per system: Serial,
Memory, LCD,..
Mix & match with different
MCU modules
On-line community:
www.towergeeks.org
Support for
all ColdFire+
and
Kinetis MCUs!
Rapidly build a prototype
of your end application
TM
External Use
23
TWR-MEM
TWR-LCD
TWR-SENSOR-PAK
Available Tower System Modules
8-bit
32-bit –
Power Architecture
16-bit
DSC
32-bit - ColdFire
TWR-S12GN32
TWR-S12G128
TWR-56F8257
TWR-MCF51JE
TWR-MCF51CN
TWR-MCF51MM
TWR-MCF51QM
TWR-MCF5225X
TWR-MCF5441X
32-bit Kinetis
Processor
Modules
(USD
$39-$119)
TWR-S08LL64
TWR-S08LH64
TWR-S08JE128
TWR-S08MM128
TWR-S08GW64
TWR-S08UNIV
Serial
Peripheral
Modules
(USD
$15 – $149)
Prototyping
TWR-SER
TWR-SER2
Wi-Fi
TWR-PROTO
Analog
Mesh Networking
TWR-ADCDAC-LTC
TWR-RF-SNAP
Audio
24
Displays
TWR-SENSOR-PAK
TWR-LCDTWR-SENSOR-PAK-AUTO RGB
TWRPI-MMA6900
TWRPI-MPL115A
TWR-AUDIO-DA7321 TWR-AUDIO-SGTL
TM
External Use
Audio
Sensors &
Plug-Ins
Memory
TWR-WIFI-RS2101 TWR-MEM
TWR-WIFI-G1011MI
TWR-WIFI-AR4100
TWR-MPC5125
MFi
MFi
TWR-DOCK2
TWR-DOCK
Visit www.freescale.com/tower
TWR-K60D100M
TWR-K70F120M
TWR-K40X256
TWR-K60N512-IAR
TWR-K60N512-KEIL
TWR-K53N512
KWIKSTIK-K40
Medical
MED-EKG
Example Tower System MFi System Configurations
+
TWR-K60D100M
+
+
TWR-DOCK2
+
MED-EKG
TWR-K53N512
+
TWR-K60D100M
TWR-DOCK
+
+
TWR-K70F120M
TWR-LCD-RGB
TWR-DOCK2
TM
External Use
25
iOS App
Based EKG
=
iOS App Based
Altimeter
TWR-ELEV
+
+
=
TWR-ELEV
TWRPI-MPL115A
TWR-DOCK2
MFi Simple Digital
Speaker Dock
TWR-ELEV
+
+
=
=
TWR-ELEV
MFi GUI Digital
Speaker Dock
Learn more at: www.freescale.com/ProcessorExpert
Freescale Processor Expert Software
Create, configure, generate
software and drivers for
Freescale microcontrollers.
Product Features
• Standalone or Integrated for
−
Eclipse based IDE's
− Freescale CodeWarrior
− IAR Embedded Workbench
− Keil MDK
Master complex peripherals with a
few mouse clicks, without the
need to read thousands of data
• Supports Kinetis, S08, S12, S12Z,
sheet pages.
Libraries
(DSP, Math,
Encryption)
Application
Specific
Middleware
Stacks
(TCP/IP, USB)
Software and Hardware
Evaluation & Dev Tools
Customer Application
Operating
System
BSP, Drivers &
HAL
Bootloader
MCU Hardware
TM
External Use
26
•
•
•
•
•
•
ColdFire, DSC and Power Architecture
with reusable software components
Knowledge base of pins, registers,
muxing, clocks and dependencies
Initialization and driver code generation
with design time consistency checking
Bare Metal and RTOS drivers
On-chip and Off-chip Device Drivers
Middleware and Stacks: RTOS, TSS
libraries and communication stacks
Component Development Environment
(CDE) to create and distribute own
components
Download at: www.freescale.com/mqx
Freescale MQX™ Software Solutions
−
Enabling the development of
connected and intelligent
applications of the future
Deterministic multi-tasking preemptive
scheduler
− Extensive inter-task synchronization,
message passing, and much more
•
(DSP, Math,
Encryption)
Application
Specific
Middleware
Stacks
(TCP/IP, USB)
Libraries
Operating
System
BSP, Drivers &
HAL
Broad networking protocol support
(TCP,UDP, ICMP, HTTP, DHCP, FTP,
Telnet, …)
− Fully re-entrant, responsive, designed for
embedded systems
•
MQX™ File System
−
•
•
External Use
27
USB 1.0/2.0; low-/full-/high-speed
Board Support Packages
−
TM
Embedded FAT file system compatible with
FAT-12, FAT-16, or FAT-32 file systems
MQX™ USB Host/Device Stack
−
Bootloader
MCU Hardware
MQX™ Real Time Communication Suite
Now with optional IPv6 add-on package
−
Customer Application
Software and Hardware
Evaluation & Dev Tools
$
Product Features
Commercial-grade MCU
• MQX™ Real Time Operating System
software platform at no cost
Kernel
with optional support packages
Pre-configured MQX Kernel, stacks, and
peripheral drivers for Freescale HW
Creating a New MFi Project 1
The Freescale MFi solution is released for the following development suites:
• CodeWarrior
• IAR
• Keil
The following examples are based on CodeWarrior (showing selected steps only)
Open CodeWarrior and select the New Project Wizard:
TM
External Use
28
Creating a New MFi Project 2
Select the target MCU device, and the Processor Expert configuration tool:
TM
External Use
29
Creating a New MFi Project 3
CodeWarrior Window after Project Creation:
TM
External Use
30
Creating a New MFi Project 4
Project Panel and Component Inspector windows:
TM
External Use
31
Creating a New MFi Project 5
MFi Component Inspector window:
TM
External Use
32
Creating a New MFi Project 6
MFi interface software, and Digital
Audio configuration:
TM
External Use
33
Android Accessories
TM
External Use
34
Android Accessories Introduction
Android Accessories do not require licensing from Google,
but several interface approaches are used
•
Android Open Accessory Protocol (AOAP), version 2.0
−
•
USB Mass Storage Device (file access only)
−
•
Optionally supported on Android 4.1 (Jelly Bean) and above
Requires MP3 etc decoding, and does not support device based playback control
Some manufacturers use USB OTG, allowing the Android device to act as Host and
stream digital audio compatible with USB Audio Class 2.0
Connectors
• USB (mini or micro) are the standard connectors, with the Android device generally
being the USB Device, although some support USB OTG in order to support USB
Audio Class 2.0
•
Mobile High-Definition Link (MHL) is a new connector option (5 or 11 pin)
that supports “HDMI” video and audio, and USB OTG
•
No special interface hardware is required for Android devices
TM
External Use
35
Android Accessory Connection Options
Wired
Wireless
Connection
USB mini
Audio
Supported
USB micro
Digital
MHL
WiFi
Yes
DLNA,
WiFi Direct,
Miracast
Digital
No
No
DLNA,
WiFi Direct,
Miracast
Wearables
and Home
Automation
A2DP audio,
Handsfree
Requires
MirrorLink for
control
No
No
Yes
(“HDMI”)
Notes/
Comments
AOAP is
optional from
Android 4.2
AOAP is
optional from
Android 4.2
Video and
USB Host
mode audio
TM
36
No
BT
Digital
Video
Supported
External Use
BLE
Freescale Android Accessory Software
Android App
Speaker
Dock
Android Accessory Software
(Examples)
Accessory
Software
Audio Decoder*
(for USB MSC only)
Accessory
Interface
Software
RTOS
Low Level
EKG
GUI
Sensor
System
MP3
AAC
Actuator
System
Digital Audio
Processing
HE AAC
APE
EKG
FLAC
Android Open Accessory Protocol (AOAP)
Others
Altimeter
OGG Vorbis
Accessory
MCU Firmware
Update
WAV
USB Mass Storage Class
•Device and AOA Detect
•Audio Streaming
•HID playback support
•HID App and Accessory communication
(requires audio decoder)
(does not support device
based playback control)
WMA
USB Host
mode
streaming
No RTOS (“Bare Metal”)
MQX
Linux
Kinetis L, Kinetis K
Kinetis K, Vybrid
Vybrid, i.MX
I2C
Driver
USB
Stack
MCU
Hardware
Accessory
MCU Firmware
Update
Altimeter
I2C
TCP/I
P
Stack
Ethernet
USB/MHL Connector
TM
External Use
37
I/O
Driver
s
Serial
Drivers
CPU DSP DMA Memory
T
M
USB
SD
Drive
r
SD
UART
I2S
Audio
Drivers
HW Codec/Class-D/
FM Modulator
I2S Analog Audio
i.MX6 Android Tablet Streaming Audio to Kinetis KL46
Digital Audio Streaming over
USB using AOAP 2.0
i.MX6 SABRE CDP
Running Android 4.3
With AOAP 2.0
Kinetis KL46
TWR-KL46
Module
USB Cable
Touch Playback Control
Audio Codec Module
TM
External Use
38
Audio Interface Reference Design
USB A
6V~12V DC
Power input
Line in
Kinetis KL26
MCU preprogrammed
with AOAP and
Playback
control software
Line out
Dialog DA7212
Audio codec
Auxiliary header
Debugger header
On/
Standby
Planned versions:
1. AOAP-KL26-AI-DA: Analog line audio with Dialog codec
2. AOAP-KL26-AI-AKM: Analog line audio with AKM codec
3. AOAP-KL26-AI-FM: FM modulated analog audio
Repeat
Shuffle
TM
External Use
39
Playback control
capacitive touch
pads
AOAP Solutions Release Plan
Software
Function and
OS
MCU/MPU
Family (CPU)
Kinetis L
AOAP no OS
Kinetis K
Kinetis K
AOAP MQX
(integrated in FAS)
Vybrid (M4)
Vybrid (A5)
AOAP Linux
(integrated in FAS)
Vybrid (A5)
i.MX6
Q4-2013
Development
Alpha
Beta
General
Availability
Q1-2014
Q2-2014
Q3-2014
Q4-2014
l
l
l
l
l
l
l
l
l
l
l
l
l
l
l
l
l
l
l
Notes:
1. Subject to change
2. FAS is Freescale Audio Solution Framework
TM
External Use
40
Accessory Demos
and Examples
TM
External Use
41
Fully Digital Speaker Dock
• Required
with all iPhone, iPad and iPod devices with
Lightning connector, and Android devices (supporting
AOAP)
• Best
−
potential audio quality
Depends only on quality of source material and speaker
dock implementation
• Easy
AAC, MP3 Decoder
to add digital audio processing
USB Isochronous Audio
USB Isochronous Driver
Digital Audio
Processing
Amp
TM
External Use
42
DAC
Amp
Demo example: Simple Speaker Dock
•
•
Simple playback control
USB digital audio streaming, or
−
•
Optional analog audio line output
Optional digital audio processing
AAC, MP3 Decoder
USB Digital Audio
DAC
Volume
TM
External Use
43
Demo example: GUI Speaker Dock
•
•
Playback and audio control via touchscreen LCD
USB digital audio streaming, or
−
•
Optional analog audio line output
Optional digital audio processing
AAC, MP3 Decoder
USB Digital Audio
DAC
TM
External Use
44
App-Based Speaker Dock
•
Uses smartphone based App to control
the speaker dock
−
Saves on separate GUI on speaker dock
−
Limited to smartphone or devices that
support App-Based Accessories
(such as iOS devices)
−
AAC, MP3 Decoder
Possible with multiple connection options
USB Digital Audio
DAC
TM
External Use
45
Demo example: EKG - Electrocardiogram
•
Kinetis K53 with EKG sensor module
•
iOS App to display EKG graph and heart rate
App for
Accessory
EKG Sensor I/F
Sensors
TM
External Use
46
App Accessory
Communication
Control
MCU or MPU
Demo example: Altimeter
•
Air pressure based altimeter
−
•
High sensitivity: ~ 30 cm (12”)
Ambient air temperature
App for
Accessory
MPL115A Sensor
TM
External Use
47
App Accessory
Communication
Anatomy Of An App-Based Accessory
•
•
App provides
−
User interface
−
Network or Remote access
−
Optional additional processing
App for
Accessory
Accessory provides
−
Additional sensors

−
E.g. Motors, Switches, Valves, Lights
Local control and processing

−
or
Actuators as needed

−
E.g. Pressure, Chemical (e.g. Glucose),
Level, Light, Voltage, Current
May be very low power and
independent of device
Sensors
Optionally, power for device
TM
External Use
App-Based
Accessory
48
App Accessory
Communication
Control
MCU or MPU
Actuators
Freescale Audio Solution
TM
External Use
49
Freescale Audio Solution Overview
Focus on Mono and Stereo audio with digital interconnect and
processing, and multi-channel audio accessories
•
Optimized for ARM Cortex-M4 core and Kinetis K family
− Wide
range of available MCUs with a rich selection of memory,
peripheral, and connectivity options
− Will support ARM Cortex-Ax (Vybrid and i.MX) families later,
primarily for multi-channel applications
•
Flexible solution framework for easy configuration and customization
•
Basic audio software is free for use on Freescale MCUs
− Premium
Audio Functions are subject to a software royalty and possibly to
licensing from IP owners
•
Tower System support for development and rapid prototyping
TM
External Use
50
Audio Solution Software
Freescale Audio Solution
Value Added
Audio
Stereo
Widening
Dolby
DTS/SRS
Standard
Audio
Volume
Control
Tone
Control
Graphic
Equalizer
SW Codecs
RTOS
Sample Rate
Converter
MP3
AAC
HE AAC
APE
FLAC
OGG Vorbis
WAV
WMA
de.
de.
de.
de.
de.
en., de.
de.
No RTOS (“Bare Metal”)
MQX
Linux
Kinetis L, Kinetis K
Kinetis K, Vybrid
Vybrid, i.MX
TCP/IP
Stack
MCU
Hardware
Loudness
Control
Others
en., de.
USB
Stack
Low Level
VoIP
USB
CPU
DSP
I/O
Drivers
DMA
Memory
T
M
Ethernet
TM
External Use
SD
Driver
51
SD
UART
I2S
Serial
Drivers
Audio
Drivers
HW Codec/Class-D/FM Modulator
I2S
Analog Audio
Freescale Audio Solution Resource Requirements
Current software release data for Kinetis K20
Total ROM
Output
Total RAM Input Buf
(Flash)
Buf
Component
MHz
DMIPS
Test Vector
MP3 decode
21643
15276
12.9
10.32
320c_48kHz_stereo_test1_44kHz_mp3.mp3
MP3 encode
23604
18494
20.47
16.38
320c_48kHz_stereo_test1_44kHz_mp3.wav
AAC decode
32791
29014
12.05
9.64
320c_48kHz_stereo_test1_44kHz_mp3.aac
Ogg Vorbis decode
59120
106510
17.18
13.74
q4_48000_s_test1_44khz_mp3.wav.ogg
Ogg Vorbis decode (low-mem)
59120
52066
WAV decoder
5724
208
4096
16384
WAV encoder
5720
144
2048
8192
WMA decoder
74226
31312
256
512
FSRC
6876
9384
4096
4096
Notes: Subject to change
TM
External Use
52
Freescale Audio Solution Resource Requirements
Current software release data for Kinetis K20
.bss
Total
ROM
(Flash)
Total
RAM
6755
14904
21643
15276
12.9
10.32
320c_48kHz_stereo_test1_44kHz_mp3.mp3
298
6090
18196
23604
18494
20.47
16.38
320c_48kHz_stereo_test1_44kHz_mp3.wav
20768
262
11761
28752
32791
29014
12.05
9.64
320c_48kHz_stereo_test1_44kHz_mp3.aac
Ogg Vorbis decode
35826
14
23280
106496
59120
106510
17.18
13.74
q4_48000_s_test1_44khz_mp3.wav.ogg
Ogg Vorbis decode (lowmem)
35826
14
23280
52052
59120
52066
WAV decoder
5366
16
342
192
5724
208
4096
16384
WAV encoder
5368
0
352
144
5720
144
2048
8192
WMA decoder
48698
0
25528
31312
74226
31312
256
512
FSRC
1756
0
5120
9384
6876
9384
4096
4096
Component
.text
.data .rodat
a
MP3 decode
14516
372
MP3 encode
17216
AAC decode
Input Output
MHz
Buf
Buf
DMIPS
Test Vector
Notes: Subject to change
TM
External Use
53
Audio Solution Components Release Plan
Software
Function and
OS
MCU/MPU
Family (CPU)
Q4-2013
ARM Cortex-M4
MP3 Decoder
ARM Cortex-Ax
ARM Cortex-Ax
ARM Cortex-Ax
ARM Cortex-M4
HE AAC Decoder
ARM Cortex-Ax
ARM Cortex-M4
FLAC Decoder
ARM Cortex-Ax
OGG Vorbis
Decoder
ARM Cortex-M4
ARM Cortex-Ax
ARM Cortex-M4
WAV Decoder
ARM Cortex-Ax
ARM Cortex-M4
WAV Encoder
ARM Cortex-Ax
ARM Cortex-M4
WMA Decoder
ARM Cortex-Ax
ARM Cortex-M4
ALAC Decoder
ARM Cortex-Ax
ARM Cortex-M4
ALAC Encoder
ARM Cortex-Ax
ARM Cortex-M4
APE Decoder
ARM Cortex-Ax
Beta
General
Availability
Q1-2014
Q2-2014
Q3-2014
Q4-2014
l
l
Software
Function and
OS
MCU/MPU
Family (CPU)
ARM Cortex-M4
OPUS Decoder
ARM Cortex-Ax
l
l
ARM Cortex-M4
OPUS Encoder
l
ARM Cortex-Ax
l
ARM Cortex-M4
AAC Decoder
Alpha
l
ARM Cortex-M4
MP3 Encoder
Development
l
ARM Cortex-M0+
l
l
l
l
l
l
l
l
l
l
l
l
l
l
l
l
l
l
l
Volume Control
ARM Cortex-M4
ARM Cortex-Ax
ARM Cortex-M0+
Tone Control
ARM Cortex-M4
ARM Cortex-Ax
ARM Cortex-M4
Mixer (many to 1)
ARM Cortex-Ax
FSRC
(8, 16, 24-BIT)
ARM Cortex-M4
SRC44.1
(8, 16, 24-BIT)
ARM Cortex-M4
SRC48
(8, 16, 24-BIT)
ARM Cortex-M4
SRC96
(8, 16, 24-BIT)
ARM Cortex-M4
ARM Cortex-Ax
ARM Cortex-Ax
ARM Cortex-Ax
ARM Cortex-Ax
ARM Cortex-M4
Parametric Equalizer
ARM Cortex-Ax
Playback Speed
Control
ARM Cortex-M4
ARM Cortex-Ax
Development
Alpha
Beta
General
Availability
Q4-2013
Q1-2014
Q2-2014
Q3-2014
Q4-2014
l
l
l
l
l
l
l
l
l
l
l
l
l
l
l
l
l
l
l
l
l
l
l
l
l
l
l
l
Notes: Subject to change
TM
External Use
54
TWR-AUDIO-SGTL Overview
•
The TWR-AUDIO-SGTL is a peripheral module compatible with the
Freescale Tower System. The TWR-AUDIO-SGTL peripheral module
features the SGTL5000 audio codec and provides an audio interface for
the Freescale Tower System.
•
The SGTL5000 is a low-power stereo codec that includes a headphone
amplifier and is designed to provide a comprehensive audio solution for
portable products that require line-in, microphone-in, line-out,
headphone-out and digital I/O.
•
As part of the Freescale Tower System, the TWR-AUDIO-SGTL module
may be used with a wide range of Tower System MCU/MPU, peripheral,
sensor and communication modules.
TM
External Use
55
TWR-AUDIO-SGTL
•
SGTL5000 low-power stereo
codec with headphone amplifier
•
Tunable clock generator
•
Stereo line-in on 3.5 mm jack
•
Stereo line-out on 3.5 mm jack
•
Headphone output on 3.5 mm
jack
•
Capacitor-less headphone output
on 3.5 mm jack
•
Smartphone compatible headset (headphone output/microphone input) on 3.5 mm jack
•
Microphone input on 3.5mm jack
•
Space provided on board to mount an electret microphone
•
Compatible with Tower System processor modules using Kinetis, Kinetis L, Vybrid and
ColdFire+ microcontrollers
•
TWR-AUDIO-SGTL Rev D2 replaces previous module revisions.
TM
External Use
56
TWR-AUDIO-DA7321 Tower Peripheral Module
•
DA7320 multi-channel Audio CODEC processor with
adjustable DSP effects
•
Dynamic Range Control, Psychoacoustic Bass Boost, n-band Equalization
•
SRS Sound support to enhance end user listening for media playback
•
Stereo AUX_IN on a 3.5mm jack socket
•
MIC input on a 3.5mm jack socket
•
MIC input via an on-board mems microphone
•
Smartphone compatible HEADSET connection on a 3.5mm jack socket
•
Interchangeable GND and MIC routing to the smartphone jack allows
multiple headsets to be supported
•
Compatible with the Freescale Tower System
TM
External Use
57
TWR-AUDIO-DA7321 Tower Peripheral Module
DA7321 Audio Codec
TM
External Use
58
DA7321 Audio Enhancements
INPUT LEVEL (dBFS)
•
SRS Sound improves the audio
image size, bass sensation and
dynamics of an audio system
TM
External Use
59
-70dB
-50dB
-60dB
-40dB
-30dB
-20dB
-10dB
0
0
io (A/B)
ssion Rat
Compre
Lin
ea
rR
esp
o
ine
Noise Gate
Attenuation
-10dB
B
-20dB
-30dB
Make-Up
Gain
L
nse
A
Limiting
Level
-40dB
Soft Knee
Range
Noise Gate
Transition
Region
(Expansion
Region)
-50dB
-60dB
-70dB
-80dB
-90dB
Soft Knee Thresholds
-100dB
OUTPUT LEVEL (dBFS)
Limiting Level
Limiting Threshold
Psycho-acoustic bass boost offers
improved perceived low frequency
performance for low cost speakers
-80dB
Compression Threshold
•
DRC enables more “perceived”
loudness without distortion on
headphone and speaker
-90dB
Noise Gate Threshold
•
-100dB
Target Audio Applications
Mono and Stereo audio with digital interconnect
and processing, and multi-channel audio accessories
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
MFi Speaker Docks
MFi Accessories
Android Speaker Docks
Android Accessories
SoundBars
Portable audio recorders
Gaming Headsets
Networked audio endpoints
USB microphones
USB speakers
Xbox 360 Accessories
Musical effects equipment
Professional audio equipment
VoIP Intercom systems
VoIP Public Address (PA) systems
VoIP telephony
Automotive after market audio
And many more, let your imagination run wild
TM
External Use
60
Freescale Audio Solution (FAS) Framework
•
Freescale Audio Solution (FAS) Framework is being developed for Kinetis, Vybrid, and i.MX
processors
• The framework includes functional blocks to deliver media player functionality:
− Multimedia Framework with Radio Tuner and CD Support.
− CE Device Connectivity supporting MFi, USB, SD and AOAP
− External device management and control.
− Input management and control for touch screen, buttons and knobs.
− HMI Framework
− Bluetooth Stack and Profiles with AEC/NS (HFP, A2DP, AVRCP)
• Using an OS Abstraction provides platform support on MQX and Linux* and can be modified
to work with any modern operating system
TM
External Use
61
AA Solutions Framework and Components
Standard
Audio
SW Codecs
RTOS
Low Level
Hardware
Stereo
Widening
Dolby
Volume
Control
DTS/SRS
Tone
Control
Graphic
Equalizer
iOS App
Others
VoIP
Loudness
Control
(Examples)
Sample Rate
Converter
MP3
AAC
HE AAC
APE
FLAC
OGG Vorbis
WAV
WMA
en., de.
de.
de.
de.
de.
de.
en., de.
de.
No RTOS (“Bare Metal”)
MQX
Linux
Kinetis L, Kinetis K
Kinetis K, Vybrid
Vybrid, i.MX
USB
Stack
TCP/IP
Stack
MCU
USB
SD
Driver
CPU
DSP
I/O Drivers
DMA
Serial
Drivers
MFi Interface Software
Audio Solution Software
Value Added
Audio
Accessory
Software
EKG
Sensor
System
GUI
Accessory
MCU Firmware
Update
Altimeter
Actuator
System
Digital Audio
Processing
EKG
Others
Accessory
MCU Firmware
Update
Altimeter
Lightning
30-pin
MFi Interface
Software
RTOS
Audio
Drivers
Low Level
Hardware
HW Codec/Class-D/FM Modulator
Memory
Speaker
Dock
No RTOS (“Bare Metal”)
MQX
Linux
Kinetis L, Kinetis K
Kinetis K, Vybrid
Vybrid, i.MX
I2C
Driver
USB
Stack
MCU
I2C
TCP/IP
Stack
T
M
CPU
USB
SD
Driver
DSP
Ethernet
I/O
Drivers
DMA
SD
Serial
Drivers
Audio
Drivers
HW Codec/Class-D/
FM Modulator
Memory
UART
I2S
I2S
Analog Audio
T
M
Ethernet
SD
UART
I2S
I2S
Analog Audio
Dock Connector
Other
Freescale Audio Solution (FAS) Framework Architecture
Customer Applications
Media
Indexing
Media
Device
Support
Playlist /
Play
Queue
OS Abstraction Layer
OS
Low Level
Hardware
Linux
MQX
USB
Stack
TCP/IP
Stack
SD
Driver
I/O
Drivers
DSP DMA Memory
Ethernet SD UART I2S
MCU /MPU
3rd
Additional
Party OS
Support (uItron)
Serial
Drivers
Audio
Drivers
HW Codec/Class-D/FM Modulator
TM
USB
Platform
Teams
AA Team
I2S
3rd Party
Analog Audio
Android App
(Examples)
Android Accessory Software
Media
Browser
Input Manager
Framework
Media
Player
Device Manager
Audio Solution
Software
FAS
Reference iOS / Android Apps
Common Audio Framework API
Speaker
Dock
EKG
Accessory
Software
GUI
Sensor
System
Audio Decoder*
MP3
AAC
Actuator
System
HE AAC
Accessory
Interface
Software
62
APE
EKG
FLAC
RTOS
Low Level
Android Open Accessory Protocol (AOAP)
Others
Accessory
MCU Firmware
Update
Altimeter
OGG Vorbis
WAV
USB Mass Storage Class
• Device and AOA Detect
• Audio Streaming
• HID playback support
• HID App and Accessory communication
WMA
USB Host
mode
streaming
(requires audio decoder)
(does not support device
based playback control)
No RTOS (“Bare Metal”)
MQX
Linux
Kinetis L, Kinetis K
Kinetis K, Vybrid
Vybrid, i.MX
I2C
Driver
USB
Stack
MCU
I2C
TCP/IP
Stack
SD
Driver
I/O
Drivers
Serial
Drivers
CPU DSP DMA Memory
T
M
USB
Ethernet
USB/MHL Connector
External Use
Digital Audio
Processing
(for USB MSC only)
Hardware
TM
Accessory
MCU Firmware
Update
Altimeter
SD
UART
I2S
Audio
Drivers
HW Codec/Class-D/
FM Modulator
I2S
Analog Audio
Freescale Audio Solution (FAS) Framework Release Plan
Software
Function and
OS
MCU/MPU
Family (CPU)
Q4-2013
Development
Alpha
Beta
General
Availability
Q1-2014
Q2-2014
Q3-2014
Q4-2014
l
l
l
l
l
l
l
l
l
l
l
l
l
l
Kinetis K
FAS Framework v1
MQX
Vybrid (M4)
Vybrid (A5)
FAS Framework v1
Linux
Vybrid (A5)
i.MX6
Notes:
1. Subject to change
2. FAS is Freescale Audio Solution Framework
TM
External Use
63
Professional Services Focus
Software Services
• Linux, Android, MQX BSP’s,
Audio Framework
MSS Primary Focus Area
Software
UI &
Applications
Middleware
FSL BSP
Drivers
Hardware
OS Kernel
Kinetis
Vybrid
i.MX
Solutions Solutions Solutions
MSS Architecture Focus Area
TM
External Use
64
•
−
Customization
−
Integration
−
Development
−
Porting
−
Testing
−
Optimization
−
Issue analysis, Debug and Fix
Long-term support
on Customer Board
Hardware Services
• Schematic and layout
optimization and review
• Simulation
• On-site board bring-up
Services Development Methodologies And Quality
Engineering Discipline
design
define
develop
• Requirements
Gathering
• Design
Consulting
• Custom
Development
• Project
Assessments
• System
Consulting
• Porting /
Migration
• IP Selection
• Architecture
• Integration
integration
and test
• Testing
• Documentatio
n
• Performance
Testing
• Performance
Optimization
deploy
• Knowledge
Transfer
• Project
Specific
Support
(3rd Level)
• Maintenance
• Performance
Tuning
Quality Assurance (ISO, CMMI & SPICE Level III)
TM
External Use
65
Summary
TM
External Use
66
Accessories and Digital Audio MCUs and MPUs
2 channel Audio Processing,
USB, Ethernet, Wireless
Connectivity
ARM9
i.MX2
family
MQX RTOS
ARM
Cortex-A5
and
Cortex-M4
Vybrid
family
ARM
CortexM4
Basic Audio
Processing
ARM
USB Digital
Audio Streaming
CortexM0+
Kinetis L
family
TM
External Use
67
No OS
Kinetis K
family
MQX Lite RTOS
Media Library Browsing,
Complex Audio Processing,
Multi-channels Audio
Linux OS
ARM
Cortex A9
i.MX6
family
Summary
•
The Freescale Audio Solution (FAS) and Framework are designed for a wide
range of stereo and mono audio applications
−
Kinetis K, Vybrid and i.MX for audio processing, Kinetis L for streaming only applications
•
Freescale MFi software solution and TWR-DOCK2 support Made For iPod (MFi)
Accessories and App-Based Accessories development
•
Freescale AOAP software supports accessories development for most Android
devices
TM
External Use
68
Q &A
TM
External Use
69
TM
www.Freescale.com
© 2014 Freescale Semiconductor, Inc. | External Use
Download PDF
Similar pages