Fujitsu GDC Product for Wraparound View System and Graphic

Fujitsu GDC Product for
Wraparound V
iew S
ystem and
View
System
Graphic Cluster Platform
Mar., 2011
Welch Ding (丁洁早）
丁洁早）
Fujitsu Semiconductor (Shanghai) Co., Ltd.
Automotive division
Copyright 2010 FUJITSU SEMICONDUCTOR LIMITED
Fujitsu Semiconductor at a glance
Corporate Name
FUJITSU SEMICONDUCTOR LIMITED
Business
Description
Design, development, manufacturing, and sale of LSI products
Location of head
office
Nomura Shin-Yokohama Bldg.,
2-10-23 Shin-Yokohama, Kohoku-Ku, Yokohama, Kanagawa, Japan
Representative
Haruki Okada
Date of
Establishment
21st March, 2008
Capital
60 Billion JPY ( 600 Million US$)
Shareholders
Fujitsu Limited (Tokyo Stock Exchange 6702), 100% shareholder
Fiscal Year
April 1 to March 31
: President
World Wide FSL Group support area
FSL support area
Fujitsu Semiconductor Korea Ltd. (FSK)
Seoul:MCU, Graphic support
Fujitsu Semiconductor Europe GmbH (FSEU)
London : Mixed Signal DC
Frankfurt : MCU, ASIC DC/Support
Munich : GDC/Support(GCC)
Linz : Software development(FEAT)
Fujitsu Semiconductor Ltd.(FSL)
Fujitsu Electronics, Inc(FEI)
Fujitsu Semiconductor America Inc. (FSA)
Fujitsu Semiconductor Asia Pte Ltd. (FSAL)
Fujitsu Semiconductor Pacific Asia Ltd.(FSP)
Fujitsu Semiconductor (Shanghai) Co.,Ltd.(FSS)
Shanghai : MCU, Graphic support
Hong Kong : MCU, ASIC DC, Graphic support
Detroit : MCU, Graphic support
Supplying our products to almost all car makers worldwide
FSL Automotive Activity
CAN / LIN
Chassis
Safety
Body
F2MC(16bit), FR(32bit)
Stepping Motor
GDC
F2MC(16bit), FR(32bit)
GDC : 2D/3D Graphics Display,
Capture function expand
Stepping Motor
Controller macro
Quality
Dash
board
Multimedia
High performance
CPU
Safety
Motor
FlexRay
GDC
1394Automotive
MOST(MediaLB)
APIX
F2MC(16bit), FR(32bit)
For High speed NW for entertainment.
For send DVD data and Camera data.
For Car navigation system and HMI
GDC Application Evolution
ADAS
Surround Monitor
(Viewing+Sensing)
Cluster
Camera
Camera
OMNIVIEW
Approaching
Object
Detection
Rear seat entertainment
Center stuck
Navigation
HMI
Camera
GDC Roadmap
T.B.D
T.B.D
5th5th-generation
Ruby
Cat4b,5
Cluster SoC
ADAS
Mid AVN
Display audio Emerald-P
ADAS
- ARM CortexCortex-A9
MB86298
4th4th-generation
Carmine
- OpenGL ES2.0/OpenVG1.0
- PCIPCI-Express, DDR2DDR2-800
- 90nm, TEBGA
(MB86R11)
MB86297
-
Geometry/Rendering Engine 266MHz
8Layer Overlaying
OpenGL ES1.1
90nm, 2.3W, TEBGA
Jade
JadeJade-D
Cluster SoC
Low AVN
Display audio
MB86R02
MB86R01
-
ARM926 333MHz
ARM926
2D, 3D GDC
Indigo
CAN/MLB/USB/IDE/I2S/SD...
90nm
APIX IF
TCON/RSDS
TEBGA, 1W
Ta=105℃
Ta=105℃
90nm
ARM CortexCortex-A9
DDR2/3DDR2/3-800(400MHz)
OpenGL ES2.0/OpenVG1.1
Programmable Shader
65nm
2008
Low AVN
Display audio
ADAS
Emerald-LL
(T.B.D)
- Optimized function
T.B.D
Jade-LC
Sapphire
MB88F332
2007
-
-
- Jade Subset
- 90nm
（MB91590)
CY
2006
533MHz
- DDR2/3(533MHz)
- APIX2
Emerald-L
2009
2010
2011
2012
2013
MB91590
MB91590 to
to design
design
Graphic
Graphic Cluster
Cluster Platform
Platform
MB91590 Series SOC
Technology ： 90nm Embedded Flash Logic
Package
： QFP/LQFP208
CPU
： FR81S 128MHz/80MHz
MCU Resources ： see feature list
GDC
Resolution
： max 800×
×480 (actual target 480x240)
Frame buffer ： 800KB internal (external VRAM is not needed)
Sprite function ： 512 sprite
Graphic function ： Line
Video input ： NTSC/Digital RGB555 Zoom-in/out, rotation
Selling Points for OEM
Sing chip solution (MCU + GDC)
Internal big VRAM for graphic frame buffer
GDC has line image drawing engine
Support direct analog camera input (PAL/NTSC video)
MB91590 Block diagram
QFP/LQFP-208
GDC
Camera
LCD
WQVGA
Flash
Memory
NTSC
BT656
RGB
RGB
Data
16bit
Video
Capture
Frame
Buffer
MCU
FR81S
Draw
Engine
Flash
Display
Controller
XBS
OCD
OCD I/F
RAM
CAN
Sprite
Engine
Peripherals
UART
Timer
A/D etc.
Sound
generator
SMC
Feature of GDC on MB91590
Image Layer
Sprite Engine
Bit map (sprites) overlay display with line buffer
8bpp indirect color, ARGB-1555
SPR1
SPR0
SPR2
SPR3
Max 512 sprite
32 special sprite (blinking, auto move, animation etc.)
transparent
X
Auto image control and auto initial value setting
using command list
Line image engine
Bold Line, Dotted line
Anti-aliasing
Background
Y
Display on Screen
Video capturing
Analog NTSC, BT656, Digital RGB input
Scaling, 90ﾟ/180 ﾟ /270 ﾟ rotation
800KB internal RAM
Can be used as frame buffer for video capture, line drawing, source of sprites
RLD (Run Length Decoder) can be use
MB91590 Demo Proposal - Connection Diagram
CAN
Socket
PC (CANOE or UARTUART-CAN)
CAN
11
TFT LCD Display (1)
Normal Mode
Parking Mode
Driving Mode
Park
Mode
Driving
Mode
68%
Outside 28.5˚˚C
Car 23.5 ˚C
11:55 PM
11:55 PM
10-02-2011
Trip 21.1km
100 m
Trip 21.1km
Mileage
Sonar detection
Rear view camera
Temperature
Navigation
information
Change to Park
mode
12
Copyright 2010 FUJITSU LIMITED
TFT LCD Display (2)
Normal Mode
Tyre pressure monitor
TPMS
35psi
Car status monitor
Car
Status
36psi
11:55 PM
10-02-2011
11:55 PM
36psi
32psi
Est. remain
81.6 km
68%
10-02-2011
Trip
23.1 km
Miles
133.7 km
Car Door Detection
Tyre pressure
warning
13
Copyright 2010 FUJITSU LIMITED
MB91590 Reference Solution
BAT
ADC
LIN
UART
ADC Interfaces
CVBS Video Input
Input Capture Interfaces
CAN
ISO
Connector
Hardware Features
Software Features
6 Stepper Motors
LED Backlight Control
18 LED Signal Indicators
Sound Generator
480 x 272 LCD Panel
Motors driving (ZPD, Normal Drive)
Car Info UI display
Parking Assist
Alert Sound Playback
CVBS Video Input
14
MB91590 Reference Solution
Software Package
MB91590 Reference Solution Sample Project
Stepper Motor Driving
Rear View Camera Video Input & Parking Assistance
Access Library Display Driver
Sound Generation Driver
HMI Authoring Tools
GHDS
Documentation
Schematics
PCB Layout
Reference Solution Board Manual
Application Note
SW Modules User Manual
SW User Manual
15
MB86R11
MB86R11 to
to design
design
3D
3D OMNIVIEW
OMNIVIEW System
System Platform
Platform
MB86R11 Emerald Spec
Support 4
cameras
input
Gen. Purpose
Bus 16/32-bit
6x UART
2x SPI
2x I2C
32ch DMA
2x
Timer
PWR Mgmt
Watchdog
ARM
NEON
DSP
ARM Cortex A9
400(L)/533(P) MHz
(1000/1333 DMIPS)
2x ADC
109x GPIO
L1
L1 IICache
Cache
32k
32k
L1 DDL1
Cache
Cache
32k
32k
Full 3D 360°
°
Omniview Video
Imaging
Technology
Video Capture
Visibility
Visibility
Enhancement
Enhancement
OmniView
OmniView
Unified
Unified Shader
Shader Array
Array
Standard
IRIS Core
2D Engine
Media LB
MOST 50
Cortex A9 400/533MHz with NEON
OpenGL ES2.0 Support Graphic Engine
DDR2/DDR3DDR2/DDR3
-800/1066M 16/32bits
４x Video Capture （1280x720p）
1280x720p）
２x Display output
Internal
SRAM 64KB
Ruby Core
3D Engine
200(L)/266(P)
MHz
Video Capture
2 x CAN
L2
L2
Cache
Cache
128k
128k
GDCコア
コア
Standard
Video Capture
Video Capture
IDE66
2x SD/MMC
3x I2S
12x PWM
8x ext. IRQ
1x Ethernet
2x USB 2.0 (L)
or
APIX2
3xTX,1xRX
(P)
IrDA
Very Powerful
ARM Cortex A9
CPU Core
Top level
3D GDC
TS I/F
TCON
TCON
Dithering
Dithering
Gamma
Gamma
Correction
Correction
SIG
SIG Unit
Unit
Display Ctrl
RGB/RSDS
Display Ctrl
RGB
Support TCON
and multi-view
displays
DDR3-800(L)/1066(P)
x32
PBGA(L)/TEBGA544(P)PKG （Ball pitch 1mm）
1mm）
Various interface (I/O Peripherals)
USB2.0 Host/Func x1 Host x1 or （APIX2 Tx 3ch, Rx1ch）
Rx1ch）,
ADC, I2C, I2S, Common Parallel bus, SPI, UART/USART,
SDIO/MMC, MediaLB, CAN, PWM, IrDA, TS, Ethernet, PP-ATA, GPIO
MB86R11 Concept
User interface like a mobile phone
Around monitor and Image Recognition by Camera
Visibility Enhancement Technology
W/W Standard ARM CPU～Rich Development Envelopment、Software、ISV
Visibility Enhancement Technology
Optimize image contrast on a pixel to pixel basis
Brighten up dark region without any artifact
Original
γcorrection
Enhanced
No change light scene,
brighten up dark scene
only.
Brighten up light scene too.
What
’s OMNIVIEW?
What’s
Conventional: Near-field Top view (~ 2-3m)
Surrounding view
with 4 cameras
①
③
②
①
④
④
③
OMNIVIEW: can change view point as you like
①
②
④
③
②
Input image from Camera
Using 4-cameras,,,
(Front)
(Back)
(Left)
(Right)
Conventional tech. (Only Top
-view)
Top-view)
In case of conventional top-view,
can identify objects only near vehicle.
OMNIVIEW Tech.
In case of OMNIVIEW,
can identify wide-area with flexible view point.
Advantage / Use case of OMNIVIEW
<Conventional>
Near-field Top view
<OMNIVIEW>
Flexible view point
Advantage
can NOT identify
vehicle and pedestrian
can identify pedestrian
Use case
<Lane Change>
Confirm approaching car
<Turn left (JP)>
Confirm left-side space
MB86R11 Car Infotainment System
camera
Multi Angle
View
Additional video
output for RSE
Center console HUD/Mirror
camera
camera
4 video input
Up to 720P
MB86R11
86298
BT.656
Night Vision /
Front View Cam
Right View Cam
Digital TV
MB86R11
NTSC
Dec
Left View Cam
BluBlu-ray
USBx2
MP3/WMA..
Rear View Cam
UART
UART
HDD/BluHDD/Blu-ray/CD
Sub system
[L]
[R]
JPEG/MP4..
I2S
Bluetooth
GPS
DDR2/3
Digital
TV
camera
SDx2
NOR Flash
I2S
E-VOL/AMP
Speaker
25
Copyright 2010 FUJITSU SEMICONDUCTOR LIMITED
Software – Automotive OmniView
- Evaluation Kit for AutoOV - Authoring tool
- Library
- Document
Video capture, 3D function
＋
Software
Evaluation board
Packaging
27
Copyright 2010 FUJITSU SEMICONDUCTOR LIMITED