DEVELOPMENT OF A DATA ANALYSIS TOOL FOR ASSESSMENT

DEVELOPMENT OF A DATA ANALYSIS TOOL FOR ASSESSMENT
Lynne Midori Onitsuka
B.S., California State University, Sacramento, 1997
PROJECT
Submitted in partial satisfaction of
the requirements for the degree of
MASTER OF SCIENCE
in
COMPUTER SCIENCE
at
CALIFORNIA STATE UNIVERSITY, SACRAMENTO
SPRING
2009
DEVELOPMENT OF A DATA ANALYSIS TOOL FOR ASSESSMENT
A Project
By
Lynne Midori Onitsuka
Approved by:
, Committee
Dr.
r
Chair
ne Lee
, Second
Reader
'Dr. Anne-Louide Radimsky
Date:
t
;1A
i 2I9-
ii
Student: Lynne Midori Onitsuka
I certify that this student has met the requirements for format contained in the University
format manual, and that this Project is suitable for shelving in the Library and credit is to
be awarded for the Project.
Date
Dr. Cui Zhang, Graduate Cooldinator
Department of Computer Science
iii
Abstract
of
DEVELOPMENT OF A DATA ANALYSIS TOOL FOR ASSESSMENT
by
Lynne Midori Onitsuka
The purpose of this project is to develop a data analysis tool for assessment. There are
three tiers of users: public, data entry, and faculty. The public can view non-sensitive
assessment information. In addition to accessing public information, the data entry tier
has the ability to insert, delete, or modify information. This includes preparing rubric
forms and entering the raw data associated with those forms. The faculty tier can access
not only public information but also any sensitive information. This includes interviews,
evaluations, surveys, industrial visits, and other forms of raw data. In addition, the
faculty will have access to a menu of available analytical methods. These methods will
be used to analyze the data resulting from implementation of a specified rubric and
provide associated reports.
This project is designed as a web-based application. This application provides an
efficient and flexible environment for entering data and utilizing the data analysis tool.
In addition, it will provide a means to effectively reach a large audience. This project
uses a three-tier web application architecture. The presentation layer is the user interface
available via the internet. The business layer is the PHP processing that is done in the
iv
background. This is the layer that sends and receives requests between the presentation
layer and the third layer, the data layer. The data layer is a MySQL database. Overall, it
utilizes a LAMP (Linux, Apache, MySQL, PHP) open source web platform. As a
measure of security, only the owner and web daemon have access to the files that
comprise this project.
,Committee Chair
Dr. Ma
Date
DateI
oale Lee
/
, t
v
ACKNOWLEDGMENTS
I would like to thank Dr. Mary Jane Lee, Dr. Anne-Louise Radimsky, and Dr. Cui Zhang
from the Department of Computer Science. They have been supportive and instrumental
in my completion of this project. I would also like to thank my husband, Todd Koropp
for his love and support. He has been by my side through the entire process and gave me
the strength to never give up.
vi
TABLE OF CONTENTS
Page
Acknowledgments ............................................
VI
List of Tables ............................................
IX
List of Figures .............................................
X
Chapter
1. INTRODUCTION .............................................
1
Project Overview ......
1................................
Open Source Technology .............................................
3
2. USER REQUIREMENTS AND INTERFACE DESIGN ...................................... 6
Public ............................................
8
Faculty............................................................................................................
12
Data Entry ............................................
24
3. SYSTEM DESIGN AND DEVELOPMENT ............................................
51
Overview.......................................................................................................... 51
Mission ............................................
54
Goals ............................................
55
Objectives ............................................
55
Outcomes ............................................
60
Performance Criteria ............................................
64
Evaluation ................
71
Login................................................................................................................ 83
Logout ................
84
Database Design ................
84
4. TESTING.............................................................................................................. 88
Mission ................
88
Goals ................
88
Objectives ................
88
vii
Outcomes ......................
93
Performance Criteria ......................
96
Evaluation ......................
99
Login ......................
103
Logout ......................
104
5. CONCLUSION................................................................................................... 105
Future Work ......................
106
Appendices ......................
107
Appendix A. File Layout ......................
108
Appendix B. Database Tables ......................
114
Bibliography.............................................................................................................
117
viii
LIST OF TABLES
Table 1. Functionality overview........................................................................................ 7
Table 2. Attachment table.............................................................................................. 114
Table 3. Course table .............................
114
Table 4. Evaluationheader table .............................
114
Table 5. Evaluationscore table..................................................................................... 114
Table 6. Evaluation-team table .............................
115
Table 7. History table .............................
115
Table 8. Objective table .............................
115
Table 9. Objectiveattachment map table .............................
115
Table 10. Objectiveoutcome map table .............................
116
Table I 1. Outcome table .............................
116
Table 12. Rubriccriteria table .............................
116
Table 13. Rubriccriteria_category table .............................
116
Table 14. Rubricform table.......................................................................................... 116
ix
LIST OF FIGURES
Figure 1. Project overview................................................................................................. 3
Figure 2. Mission user interface .....................................
8
Figure 3. Goals user interface............................................................................................ 9
Figure 4. Objectives public user interface .....................................
10
Figure 5. Outcomes public user interface........................................................................ 11
Figure 6. Objective-outcome table .....................................
11
Figure 7. Objective-outcome matrix................................................................................ 12
Figure 8. View attachments .....................................
13
Figure 9. View rubric form .....................................
15
Figure 10. View evaluation data .....................................
16
Figure 11. Data analysis - select outcome .....................................
17
Figure 12. Data analysis - select course........................................................................... 17
Figure 13. Data analysis - select semester and year ..............
....................... 18
Figure 14. Analysis - select result type .....................................
19
Figure 15. Data analysis - mean result type .....................................
20
Figure 16. Data analysis - median result type .....................................
21
Figure 17. Data analysis - mode result type .....................................
22
Figure 18. Data analysis - percentage result type ...........
.......................... 23
Figure 19. Data analysis - raw data result type .....................................
24
Figure 20. Data entry - maintain objectives..................................................................... 25
x
Figure 21. Data entry - enter attachment .....................................
26
Figure 22. Select attachment............................................................................................ 27
Figure 23. Update attachment.......................................................................................... 28
Figure 24. Enter outcome .....................................
29
Figure 25. Update outcome.............................................................................................. 30
Figure 26. Update matrix - select objective .....................................
31
Figure 27. Update matrix - update outcomes .....................................
32
Figure 28. View criteria-category .....................................
33
Figure 29. View criteria .....................................
34
Figure 30. Start rubric form .....................................
35
Figure 31. Update rubric form - select rubric .....................................
36
Figure 32. Update rubric form - modify form .....................................
37
Figure 33. Maintain criteria-category .....................................
38
Figure 34. Enter criterion................................................................................................. 39
Figure 35. Update criterion - select criteria-category .....................................
40
Figure 36. Update criterion information.......................................................................... 41
Figure 37. Prepare evaluation sheet for print................................................................... 42
Figure 38. Evaluation form for print................................................................................ 43
Figure 39. Enter course.................................................................................................... 44
Figure 40. Update course - select department .....................................
45
Figure 41. Update course - select course......................................................................... 45
Figure 42. Update course information............................................................................. 46
xi
Figure 43. Enter team ..........................
47
Figure 44. Update team ..........................
48
Figure 45. Prepare score form ..........................
49
Figure 46. Enter score form ..........................
50
Figure 47. Template ..........................
52
Figure 48. Login indicator ..........................
84
Figure 49: Database design - basic ..........................
86
Figure 50: Database design - detailed ..........................
87
Figure 51. Test - maintain objective ..........................
90
Figure 52: Test - delete objective ..........................
91
Figure 53: Test - verify deletion ..........................
91
Figure 54. Test - enter outcome ..........................
94
Figure 55. Test - update outcome ..........................
95
Figure 56: Test - start rubric form ..........................
97
xii
1
Chapter 1
INTRODUCTION
1.1. Project overview
When a program is accredited, there are nine accreditation criteria: students, program
educational objectives, student learning outcomes, continuous improvement, curriculum,
faculty, facilities, support, and program criteria. The focus has traditionally'been on
program educational objectives and student learning outcomes. As a result, this project
will provide a tool to assess these two accreditation criteria. To assess a criterion, one or
more processes will be used to "identify, collect, and prepare data to evaluate the
achievement of program outcomes and program educational objectives [1], [2]." When
assessing a program, it is important to do a top-down approach. The topmost level is the
program educational objectives, which are "broad statements that describe the career and
professional accomplishments that the program is preparing graduates to achieve [1],
[2]." There are three items which must be addressed when a program seeks to satisfy
the program educational objectives criterion. They are:
(a) published educational objectives that are consistent with the mission
of the institution and the criteria
(b) a process that periodically documents and demonstrates that the
objectives are based on the needs of the program's various
constituencies
(c) an assessment and evaluation process that periodically documents and
demonstrates the degree to which these objectives are attained [2].
This project addresses these issues by displaying the mission statements for the
University, the College of Engineering and Computer Science (ECS), and the Computer
2
Science Program. It also provides a tool for assessment and evaluation, which includes
processed reports of gathered data for analysis. The second level is the student learning
outcomes. These are "narrower statements that describe what students are expected to
know and be able to do by the time of graduation. These are related to the skills,
knowledge, and behaviors that students acquire in their matriculation through the
program [1], [2]." This project demonstrates a connection between a single objective
and one or more outcomes. In addition to demonstrating a connection, there needs to be
an assessment and evaluation process. The assessment tool allows a given outcome to
be broken down into categories. These categories are then broken down into specific
performance criteria. Each criterion is then assessed and evaluated through the analysis
of evaluation data, surveys, industrial visits, and other forms of raw data. Through these
connections and the data that support it, other assessment criteria requirements are
addressed. For example, the results from the program educational objectives and student
learning outcomes can be used to show evidence of criterion 4, continuous improvement.
Figure 1 visually displays the goals of this project.
3
Figure 1. Project overview
1.2.
Open source technology
The term "open source" was coined in January 1998 when Netscape released the source
code for Navigator [14]. Open source is a "set of principles and practices that promote
access to the design and production of goods and knowledge" [ 14]. There are a number
of advantages to using open source web technology. It has the promise of "better
quality, higher reliability, more flexibility, lower cost, and an end to predatory vendor
lock-in" [9]. Since this is a project to be maintained in an educational environment, it is
important not to be dependent on licensed software, which can expire at a future date. It
is also important to offer the source code for others to use. It can be a starting point for
many with opportunities for enhancement from any programmer interested. Open
source also is a medium in which other programmers can use and debug the software for
free. In addition, it helps "new generations of developers learn how to code." Through
4
the use of only open source web technology and the release of the code to the public, this
project will also become open source.
1.2.1
Linux
Linux, a Unix-like operating system, became available to the public on September 17,
1991 [11]. Unlike Windows and Macintosh operating systems, this operating system is
free and the source code is publicly available. Many of Linux's programs are open
source allowing users to modify and improve the software as long as proper credit is
provided. Linux follows the Portable Operating System Interface user and programming
interface. As a result, it can have extended functionality that is portable to other
operating systems [ 12]. In addition, there are thousands of applications, applets, and
software available to customize the look and feel of the system [19]. The operating
system is continually being updated with new features and support for new hardware. It
is very efficient and free. It is also the primary operating system of the College of
Engineering and Computer Science at California State University, Sacramento. This is
one of the most stable open source operating systems available.
1.2.2 Apache HTTP server
Apache HTTP server, also referred to simply as Apache, is a "public-domain open
source Web server" [4]. It is primarily used for static and dynamic web pages. It is the
5
most popular HTTP server since April 1996, and it is supported within the College, so it
will be the web server for this application [5].
1.2.3 MySQL
MySQL is a "multithreader, multi-user SQL database management system (DBMS)".
[13] It is owned by the company, MySQL AB. They maintain the software and the
licenses. However, the licenses are free for educational use. It is commonly used for
web applications and is the database component of LAMP (Linux, Apache, MySQL,
PHP). Some of the key values of MySQL AB for the MySQL server are for it to be
"free from bugs", "continuously improved while remaining fast and safe", and "the best
and the most used database in the world [3]."
1.2.4 PHP
PHP was "originally designed for producing dynamic web pages [15]." It is primarily
used for server side scripting. In 1994, a programmer, Rasmus Lerdorf, replaced a small
set of Perl script by creating a set of Common Gateway Interface (CGI) binaries in the C
programming language. These were used to display his resume and capture data, such
as, how many people visited his website. However, due to the high demand of the new
features, he publicly released his Personal Home Page Tools (PHP) on June 8, 1995.
Some of the features of PHP to be used are data iterators, error handling, and enhanced
MySQL support [15].
6
Chapter 2
USER REQUIREMENTS AND INTERFACE DESIGN
The requirements of this project are tailored to the type of user. The three types of users
are public, faculty, and data entry. The basic functionalities are viewing non-secure
information, viewing secure information, maintenance, inserting new information,
viewing raw data, and viewing data reports using a menu of analytical methods. If the
user wants to switch functions at any point in the application, then the user selects a
different function from the vertical or horizontal navigation menus to the left and top of
the website. The detailed list of functions is shown in Table 1.
7
Table 1. Functionality overview
Login
Logout
View Mission
View Goals
View Objectives
View Attachments
Add Objectives
Update Objectives
Delete Objectives
Add Attachments
Update Attachments
Delete Attachments
View Outcomes
View Objective-Outcome Matrix
View Objective-Outcome Table
Add Outcomes
Update Outcomes
Delete Outcomes
Update Objective-Outcome Matrix
View Rubric Form
Add Criteria-Category
Update Criteria-Category
Delete Criteria-Category
Add Criterion
Update Criterion
Delete Criterion
Add Course Information
Update Course Information
Delete Course Information
Add Raw Evaluation Scores
Print Evaluation Form
View Assessment Plan
View Evaluation Raw Data
View Evaluation Analysis - Mean
User Type
Public Data Entry Faculty
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
View Evaluation Analysis - Median
X
View Evaluation Analysis - Mode
X
View Evaluation Analysis - Passing Criterion
View Evaluation Analysis -Score Percentages
View Evaluation Summary
X
X
_
X
8
2.1.
Public
The public view is available to all user types. Access to the information requires no
login. The intention is to have the information viewed by students, parents, and anyone
who may be interested.
2.1.1
Mission
The mission section displays the Department, College, and University mission
statements. These statements set the tone for the purpose of each entity. By selecting
Mission in the horizontal navigation menu, the page will open by default to the
department mission statement. The vertical navigation menu allows the user to select
between the Department, College, and University mission statements, as shown in
Figure 2.
Eile
Edit
Jiew
Hiltory
gookmarks
Tools
Accessibility
lelp
HInSACRAMENTO STATE
I
Mission I Goals I Objectives I Outcomes I Login I Logout
Home
Computer Science Program
Public
De
Department Mission
College Mission
University Mission
*
search
~~~Leadershipbegins here.
|
{
_
Statement
This is the department mission.
California State University, Sacramento 1 6000 J Street l Sacramento, CA 95819 1 (916) 278-6011
Figure 2. Mission user interface
go
9
2.1.2
Goals
The goals section is for all users. It displays the Department, College, and University
goals. These goals are used to provide a direction and path of intention for each entity.
By selecting Goals in the horizontal navigation menu, the page will open by default to
the department goals page. The vertical navigation menu allows the user to select
between the Department, College, and University goals, as shown in Figure 3.
Ell
E-dit Slew
History
fookmarks
Tools
Uep
Accessibility
0SA~C..ACILWE NTO STATE
M s
o
Lt
G o a ls
Ip
O
je ct i
s
I
O
cg
no.
search
[g
jgo
is
I
Mission I Goals I Objectives I Outcomes
I Login I Logout
Computer Science Program
Home
Public
Department Goals
I
College Goals
University Goals
These are the department goals,
California State University, Sacramento I 6000 J Street I Sacramento, CA 95819 | (916) 278-6011
Figure 3. Goals user interface
2.1.3
Objectives
The objectives section displays the Department, College, and University program
educational objectives. "Program educational objectives are broad statements that
describe the career and professional accomplishments that the program is preparing
graduates to achieve [2]." When selecting Objectives in the horizontal navigation
menu, the page will open by default to the department program educational objectives.
10
The vertical navigation menu allows the user to select between the Department, College,
and University program educational objectives, as shown in Figure 4.
Ede cEdtp-
|
Miio
___ol
_ .
Estory AsosoWals!S
AccessWtyH*P
SACRAMENTO
STATE
Leodership beains here..h
19
._
t
o
,....._
4
Mission I Goals I Objective. I Outco-m-es I Login I Logout
Home
Public
Department
Objectives
College
Objectives
University
Objectives
Computer Science Program
Program Educational Objectives
a
Broad statements that describe career professional accomolishments
ObJective
Description
To be a significant contributor in one or more of the aspects associated with the development, maintenance, and
support of real world computing systems.
2
To be an effective and contributing member of a project team.
3
To be continually engaged in the pursuit of professional development opportunities, and/or pursue postgraduate
studies.
4
To assume a leadership role in their chosen career and profession.
5
To demonstrate competence in producing high quality written documents, and in reviewing and revising those
prepared by others.
6
To demonstrate competence in developing and delivering technical and non-technical presentations of high quality
to a variety of audiences.
I
To abide by the ethical standards of the profession and understand the social implications of their professional
activities .
Cal
.=I0i
vforma
5~t.
Uv*rsitv;
y
[;6000
JS5t..5
,Satr-t
nt-
CA.....
Figure 4. Objectives public user interface
2.1.4 Outcomes
When selecting Outcomes in the horizontal navigation bar, the page will open by default
to the department student learning outcomes. "Program outcomes are narrower
statements that describe what students are expected to know and be able to do by the
time of graduation. These relate to the skills, knowledge, and behaviors that students
acquire in their matriculation through the program [2]." The vertical navigation menu
allows the user to select between the Department and College student learning outcomes,
the University Learning Goals, the objective-outcome matrix, and the objective-outcome
table, as shown in Figure 5.
11
B dIMligory
TiarksIooi5 BtessbIyv_
Ele Edi
bdP - -
'
0A
SACRAMENTO STATE
-
--
Leadership begins here.
d'-
h
0
Mission I Goals I Objectives I Outcomes I Login I Logout
Computer Science Program
Home
Public
Department
Outcomes
College
Outcomes
University
Learning
Goals
View
ObjectiveOutcome
Matrix
View
ObjectiveOutcome
Table
Student Learning Outcomes
What students are expected to know at time of graduation
O~utcome
Description
a
An ability to apply knowledge of computing and mathematics appropriate to the discipline
b
An ability to analyze a problem, and identify and define the computing requirements appropriate to its solution
c
An ability to design, implement, and evaluate a computer-based system, process, component, or program to meet
desired needs
d
An ability to function effectively on teams to accomplish a common goal
a
An understanding of professional, ethical, legal, security, and social issues and responsibilities
An ability to communicate effectively with a range of audiences
An ability to analyze the local and global impact of computing on individuals, organizations, and society
a
h
Recognition of the need for and an ability to engage in continuing professional development
_
An ability to use current techniques, skills, and tools necessary for computing practice.
An ability to apply mathematical foundations, algorithmic principles, and computer science theory in the modeling
and design of computer-based systems in a way that demonstrates comprehension of the tradeoffs involved in
design choices
k
An ability to apply design and development principles in the construction of software systems of varying complexity,
(
.
j 0
-vms-nto
6000 J St-.t I So
C.lifvml. Stut UnSit5MvJtyS
,wnt.,CA95819 1 (916) 278-6011
Figure 5. Outcomes public user interface
The objective-outcome table view lists each program educational objective with a
corresponding list of student learning outcomes, as shown in Figure 6.
I
Lda tves Hlte
fl
_-
s
k
IoclscrsstiIe'"
beio
:
SACRAMENTO STATE
Leadership begins here.
Huh
r
go
Mission I Gods. I Objectives I Outcomes I Login I Lugout
Computer Science Program
Home
Public
iE
Department
4 ai Outcomes
College Outcomes
View ObjectiveOutcome Matrix
View ObjectiveOutcome Table
Objective/Outcome Table
71.
II
I
or more of the aspects associcated with the development, maintenence,'
To b'oa significant contributorin acne
_
comp Ing sysmteas.
end support of eh
a An ability to apply knowledge of computing and mathematics appropriate to the discipline
b An ability to analyze a problem, and identify and define the computing requirements appropriate to its solution
c An ability to design, implement, and evaluate a computer-based system, process, component, or program to meet
desired needs
d An ability to function effectively on teams to accomplish a common goal
fAn ability to communicate effectively with a range of audiences
iAn ability to use current techniques, skills, and tools necessary for computing practice.
An ability to apply mathematical foundations, algorithmic principles, and computer science theory in the modeling
jand design of computer-based systems in a way that demonstrates comprehension of the tradeoffs involved in
design choices
kAn ability to apply design and development principles in the construction of software systems of varying complexity.
2_~
_ __
___
hobe
enreffective end contributing member of -a project team.
_ _
___
_
d An ability to function effectvely on teams to accomplish a common goal
f An abilit to communicate effectielv with a rance of audiences
Figure 6. Objective-outcome table
-
12
The objective-outcome matrix displays the program educational objectives numbers and
the corresponding student learning outcomes letters in a matrix with links to tables
describing each objective number and outcome letter, as shown in Figure 7.
I Fe Edit
!
ieswHhitcy DfDowks
leels 6ccessU
Aly
Xe*
SACRAMENTO STATE
gol
Leadership begins her.e8 g.
Di
l
Mission I Goals I Objectives I Outco.es I Login I Logout
Computer Science Program
Home
Public
Department
Outcomes
College
Outcomes
View
ObjectiveOutcome
Matrix
Objective/Outcome Matrix
Program
Student Learnina Outcomes
Educational
objectives
a
b
C
2~~~~~
View
ObjectiveOutcome
Table
6
7
1
e
f
g
h
ik
i
X,,XXX.,,.,,.,,,,X,,,X,,X,
X
5
d
_
X
X
X - - . X .
X
-------i-------i--~~------------ ------- i-------i-- ----- i--------i-------i------- ------X,
;
X
X,
,
X
Click on Proaram Educational Obiectives or Student Learning Outcomes to view the corresponding descriptions.
Figure 7. Objective-outcome matrix
2.2.
Faculty
The faculty view has restricted access and requires a login. This is a single username
and password that will be shared with the faculty. There is also a corresponding logout
option when the faculty user is finished using the tool. Both the login and logout links
can be found on the right hand side of the horizontal navigation menu. The intention is
to have the information viewed by faculty and those requiring restricted access to the
rubric forms and data analysis tool.
13
2.2.1
Objectives
The faculty view for objectives includes the ability to view attachments. Attachments
are uploaded documentation that is associated with one or more objectives. These
attachments may be the result of an industrial visit, surveys, or other types of assessment
data. To view an attachment, the user selects an objective from the drop-down menu or
the checkbox which selects all of the objectives. A list of corresponding objective(s) is
then displayed with the associated attachments. Each attachment listing includes a
hyperlink to the file name, the date added, and the date the file was last modified. For
example, in Figure 8 the objective, "To assume a leadership role in their chosen career
and profession", is selected. Upon clicking the submit button, the corresponding
attachment, "HP-Visit-FallO8.pdf", is displayed as a hyperlink along with the date it was
added and last modified. To view the attachment, click on the file name.
I
a
SACRAMENTO STATE
ssarei
__Lefd-rhi. b-gm- hen!
IZngo
I
-i-.
I ... I.als1 Ob--Ir
IIes
1 OutcomesI Pe....maneCnerdaI.
... Ie la. I alutl,
I IL..I I I
.taE...-e
Computer Science Program
Homne
View Attachments
Department
Objectines
CollegeObjectives
Select an objective to view the associated attachments
Select objective
University Objectives
ssoieted with he development meintenence, od nupprtolreel wodd compOtng systems.
-beoL-the aspect s
co-butorinone-oro
--
Data Entry
Maintain Objectives
view Atttachrments
Select the checkbov to select all the objectives 1l
;Si|
is'fAI
Rg5ciE|
To assume a leadership role In their chosen career and profession.
Enter Attachments
MaintainAttachments
File Nanme
Date Added
Oct
-_
-
.toonoeo.,o.En..neloO,
oeI5swoe
IDte a
18, 2008
e5t0l50O86±
Figure 8. View attachments
Lest sdified
2009
14
2.2.2 Performance Criteria
Under the performance criteria heading, a drop-down menu of available rubric forms are
listed for faculty viewing. The user selects the desired rubric form and clicks submit.
The selected rubric form displays the program and rubric form title followed by sections
of criteria-categories. Each criteria-category lists the criteria that are associated with that
category. Each criterion will contain the descriptions of each score value along with
whether the criterion is to be scored as a team or individually. If there is a criteriacategory for the selected rubric form that does not have any criteria associated with it,
then that criteria-category will not be shown. Figure 9 is an example faculty view of the
Performance Criteria.
15
tie
i
t*
d.-
Uo
Ioo
ft~y
ela
b
t1
SACRAMENTO STATE
-'5'
leod-hip begin h-
Hisioc I GoalsI
lbjeoti-es
Home
Public
Farelty
ie. RubtncForm
I Outc.me. I Pnformaece CrHte.a I A.se..ment Pl.e I EosluWaonI L.sin I
Izi
1 go
eLzuntFec-lty
Computer Science Program
View Rubric Form
Select robot | Oric9cmmncc
n
J
S-UMgIT
|
cESET F|
|
Computer Scienc
iEL |
Oral Commanlcota
ORGANIZATION
IlEaceedsCrltenl
3 - MeetsC0ri1tera
2 -ProrssoI
toICte
|Organraus
contantloiciallyand
|inorlially organizescontent
iso organizaton is a
senoenhally.
logicaly0 segoontially.
botis generallylathing.t
Mainpoints are dearlyidentihied Man
=insae
teeally
aentrtr
priysentifie d enoadandadeqoataly
|Mandconcinsaely
Mainpoints
and c__.n_.__._._
pres d
presented.
iransltons
are logicaland
_____
____
____
____ ____ ____
Tranuitons
gmoodn,erageneraly
logial andsmooth,0'
'i
ptd,
l
Belo. Epectateons
Wbob
Ia
r
isn.ta
Mainpointsaremissing
anytransitons are notlogical
andsmooth.
'tea
t transitions
a abrupto
imie ng______
lntroduction, body, conluslion Indeds lntroducton bodyci Intoduttcnfhtonclusion are not
u
n
arfedearlygalnetet, Proides a a tonduglon,
ShomeebilitytO dearlypresented. Someanidantca cnduteon
ared
o
Cler siummary
ot prolect,.ummaie,
ofsummarroegon,
_I
I. -..... .... .I . .....
standardEnglish.
f ollors colasof
consistendY
standard
English.
gtanerally
follosh coa Io
Fs
2 -Pr
ssICritea
caoryis limited.Useof
tncal
andphrasesare
lessthan trs
desirable.
4 - Exceeds
C~rtlena
3-Meets Criteria
INeat profyssional
businessauem. Neat,casualbusinessattire.
C .1"..
UN- s", I~q--
I
_dual 7_
- e.. Epectatos
PIoorscblr n oro
inappropriate
prh-,es useof tednical terms i
and
i standarddoes
English.
EnlsIFlsd
IGenerally
notfolowo
nu
c ola
01 Does
notfollow roles01standard.__________a
APPEARANCE
F
team
_
LANGUAGE
t VOCABULARY
| 4 Ece~eds
Cltlella
3 - MeetsCtea
Aggrpnite
ae o socbolry.
Generally
accptbe
o
Accurate Aoorat
uusr oftecnicl
1U.
Otochni~wi
aUtearm's
1 term
nocatulary
and te cal'
trms
_ of
andphrases.
tam
_edleldoal
L.1_2-Proreisslea to Criteria
oNarcasoal
attire.
I
Calilomi 55cr.lniw,!arrmwny,
I5ooams
__I -Bdelo Eoeetatlonvs
Attire
maporc9nate.
CA9j
t
-atearon
tooinformal Or indinidual
,
1.__.._._.628
:I(sr)
jsrrntOr
270.o00___0
Figure 9. View rubric form
2.2.3 Evaluation
Under the evaluation heading, the initial screen is an overview of the oral
communication rubric data. This displays the percentage of each score grouping: 4, 3, 2,
or 1. The data used is all the data gathered for a given criterion, as shown in Figure 10.
This is the same information displayed when selecting the View Evaluation Data link
from the vertical navigation menu.
16
Ele
La
a
tle. liv
D
Mi
Weoonfla Lo.e &-axn
L,
SACRAMENTO STATE
E
E
L-nd-/hipbrgirsh-r
.ion
IGoals I ObjeItives | Outcome.| Perftr--oce Cntetn
IAssessment
Home
Computer Science Program
Public
Score Frequencies
Faculty
Mew Evaluaton Data
Analysis
Plan
I E-oluatien I
OIRGANIZAlION
4 EceeIsCrile
| _5:~~!!g~
_.|
ranizes content logicahy
andsequentially.
Mainpointsare dearly
identiid andcondsely
presented.
Transigons
amlogicaland
'smooth
Introducdon, body, &
aredearld
cmndusion
summary
project.
deln
eatdof prom
3 -Meet
e
Lnob
I LosgenFaculty
-;;1-
1- Beua1_Expecttfons -
C
2 - Progressing Criterio
Geoneoratll
organizes
omeinforanizaton is
i]
cotn
oiall
attempted,
-Ltleedneofrgiao.
sequendally.
ladting. bot is generally
__F
Mainpointsaregenerally
Mainpointsaremissin.
identiiedandadequately Mainpointsarenot
_resented
'Transitions
aregenerally Manytrans-ions am not
mosttanstions are abruptor
logcal and smooth,
loicaln mooth.
missing.
Introducdon cmndsionare letrothonand/er
Indudes introducton,
not dearlypresented.Sine cndusion/summary a
body,&condusion.
summarize.
maiain
a
to
eyidence
of summandon,
missing_
LANGUAGEIS
VOCABULARY ___o
4 -Exeneds
CrItlenro
3 - MeatsCrIteria
2 -Predres oq Criteria
ab tory
us
lonerally acceptable
use. oauayi iieUeo
yoctxbul
Acpurate
aceo
of vocabularyand
volayAccrae s~
technIcal
tecnial ersand
termsand
toehnical
terms
P~O*aele
hndsrbe
_______
______
:
_____
followsrules Gonerallyduesnotfollow
follows ruls otf Generally
Consistently
oulesof standar English_
forstandardEnglish.
standardEnglish.
Snare.
38
8
7
38
84
38
84
38
89
03
5
S
3
lO__
-
fr _
scoft5
I -Below Expectations
Poorvocabulary
andpooror
of tochnical 1
inappropri
phrases.'iapgraeue
ftcncl
08
8
ai n frse
__:__
_
________________
Doesnotfollomrulesof
__
stndard English. _
- _
APPEARANCE
t Critera i|
I - Below EUpectalos
ed,a
3 - MeeCrCritera 2P-sgroorsslug
4 4 Eonseds
...
a
Neat profssienal business hNat,casualbuosiness NeatcasualatdrAttreappeara n to i
atoe
ttre.
'
io
aprpfae
6
0
___
O
_
13 3i
aoy
Scores _
9
94
1
I
('-7~~~~~~~~~
_______
nlmmn sns
noleet050*tn--
195ay-coo
-eCo9~5
.I- .-----
71
-1I~
--
Figure 10. View evaluation data
The Analysis link from the vertical navigation menu is the data analysis tool. The data
analysis tool uses step-by-step instructions to assist the user. Since the data analysis is
tied to outcomes, the first step is to select the student learning outcome, as shown in
Figure 11.
17
I
Edit fYido fsstory
Ei
1ebora
hmoo Accessility
tBeo
I
kb--
SACRAMENTO
STATE
Leadership begins here.
_-
s
Mission I Goals I Objectives I Outcomes I Performance citeari
I Ass-ssment Plan I Evaluation I Login I Logout Faculty
Computer Science Program
Home
Public
Step 1: Select the Student Leaming Outcome
Faculty
View Evaluation Data
Analysis
C a: An ability to apply knowledge of computing and mathematics appropriate to the discipline
C b: An ability to analyze a problem, and identify and define the computing requirements appropriate to its solution
C c: An ability to design, implement, and evaluate a computer-based system, process, component, or program to meet
desired needs
r" d: An ability to function effectively on teams to accomplish a common goal
7 e: An understanding of professional, ethical, legal, security, and social issues and responsibilities
FI, f: An ability to communicate effectively with a range of audiences
' g: An ability to analyze the local and global impact of computing on individuals, organizations, and society
( h: Recognition of the need for and an ability to engage in continuing professional development
C i: An ability to use current techniques, skills, and tools necessary for computing practice.
C j: An ability to apply mathematical foundations, algorithmic principles, and computer science theory in the modeling and
design of computer-based systems in a way that demonstrates comprehension of the tradeoffs involved in design choices
C k: An ability to apply design and development principles in the construction of software systems of varying complexity.
ARdESETI
FOANCEL-
SUBMIT
Ir"~
go
.,
'_
-I 7
g i_
f or ia : st..
S t ot o Univerity,
Uvisor o y.: -rr- a
if ColiClfm
7
2 - tr.O
lormno:A9S91e1)2661
t Cu r._r
t o,, CA
: 05 0
.?,tyI;;
0sst--
st o 1 7-m
6t
6) : 2 7 0 e,I
i
_
Figure 11. Data analysis - select outcome
The second step is to select a specific course from the drop-down menu. Only the
courses which have data corresponding to the selected student learning outcome will be
listed, as shown in Figure 12.
!Fi
Et
Fbe
IstorY,
vi-
I
1
Rmu-kd,
i__
.L- -
T-ks
A -
[enSACRAMENTO
Leadership begins here.
tb t
-
.. U:*ll.L.-
Heb
Iss
p
i
~
2
>It*
'
_.
I
1
4 -
I
. - ' q11Kw
''I
>
=
.,
.
- -
I:
u.
s
l.
I
=- -
-
-
STATE
_h|7s
9S
Mission I Goals I Objectives I Outcomes I Performance Citeria I Assess.ent Plan I Evaluation I Login I tLgout Faculty
Home
'I Public
Faculty
!Faculty
View Evaluation Data
Analysis
Computer Science Program
Step 1: Student Learning Outcome
f An ability to communicate effectively with a range of audiences
Step 2: Select the course
Select the course the team attends 11 l90Senior
Projed: Prl
!0OO1
Beginning Computer Scnce
0O1Beginning Computer Sniente
1142Advanced Cornmuter
Organization
.u
LonvuttateLnisers,5v,
eacVar
_
9|==61
Figure 12. Data analysis - select course
__ _
1,
<
nn278011
go
I
18
The third step is to select the semester and year. Only the semester/year combinations
which have data corresponding to the selected student learning outcome and course will
be listed as shown in Figure 13.
XEill
Edt
View 1fistory roolmarks
Toods
&ccessibirky iel
t
1 SACRAMENTO STATEserhg
Leadership begins here.
Mis;n
Goalsi Ob.ectes
;
Outiomes
Performane
i
riteria
IAlot
Mission I Goals I objectives I Outcomes I Performance Criteria I Assessment Plan I Evaluation I Login i Logout Faculty
Computer Science Program
Home
Public
Step 1: Student Learning Outcome
Faculty
View Evaluation Data
Analysis
f: An ability to communicate effectively with a range of audiences
Step 2: Select the course
190: Senior Project: Part I
Step 3: Select the semester and year
Select semester/year |s pring 20087j]
SUMI
C~~~~.
C~~~alfornaSttni
ia~si ,Sara
FR-ESET
I FQANCEL|
00 JstiaeISacrarnntaCA~9519 1(916)
ooo]
27'8'601I
I1
Figure 13. Data analysis - select semester and year
The final step is to select the result type. The result type options are mean, median,
mode, percentage, and raw data, as shown in Figure 14.
19
*
- -, hli Edit
0
Vie
Hs~tory
a
a-
WW-neks
-o e-s-look 6Lcessbdity
-
-
-
Help~-
SACRAMENTO
STATE
Leadership begins here.
searh
g
go
Mission I Goals I Objectives I Outcomes I Performance Criteria I Assessment Plan I Evaluation I Login I Logout Faculty
Home
Computer Science Program
Public
Step 1: Student Learning Outcome
Faculty
View Evaluation Data
f: An ability to communicate effectively with a range of audiences
+
Step 2: Select the course
Analysis
190: Senior Project: Part I
Step 3: Select the semester and year
Spring 2008
Step 4: Select the result type
Select result type
PMn=
Mode
,
Ax
California State University, Sa Percentage
Date .,. ,
=Lfl
~~~~~~RaW
I8da
MI |I FRESET | FCANCEL|
Street I Sacramento, CA 95ei9 |(916) 278-6011
Figure 14. Analysis - select result type
Once a data result type is selected, the student learning outcome, course, semester, and
year are displayed in a table at the top of the page followed by the data results. After the
data results, the user can select another result type to be displayed. These results will
use the same step one through three selections. The user can also click reset to start over
and select a new student learning outcome, course, semester, and year combination.
When the result type, Mean, is selected, the application displays the total score value, the
number of scores entered, and the mean value for each criterion. The mean is the
average scores value. An example is shown in Figure 15.
20
_lc
Edt
Y.-
I
Hreo
s
osbn,
T
SACRAMENTO STATE
go
Ll~fn~bqgins
-tg
h-r
9
sinojonI Goal. I Oblectle. I O.tUncee I PeMfonene Criter
I A......
Pln I El.aUtln I Loo I Loeout F-colty
Computer Science Program
H...
Data Results
Pub~lc
Faeul
41iewEvaluatonData
| _
Analysis
Ifr
Anability to communicatejffectmriyas th a
IL
_
l
~~
Student Le
s1rnorP
~
jey
~
|__Co
gter~Sdence
Iringout.e..
t-I
se,
ngotaudences]
-l
-
________________________
__
I|Spnno2GB
J
totE-edsCtledla
qt
~~~
0
__ .. _
_
|_..2-
OralCoeouanlatlon
ORGANIZATION
-MeetsPCrrtene _
2-rneselnstoCritera
~~~~~~Organizes
content looically and I eneraty
organizes rontent
squsentbally,
[Main
are
dearlyd
idatentified
andcoynsey
pres
e points
dnti
ied dentyod and adequately
rTranstbons
am logicaland
Inmeout _
_
lo Eopettatlees
e
|
Con3stendtly
follom
rules
of
standard Rnglish._____
Neat,
professional
buinesi
I
aroro
rm
and phrases
3
39
Mai points are missing
7
00
Manybtransitionsar not logical
and smooth,
Mosttransidons are abrupt or
missing
_ _.
68
1
enidonce o
a
izaion.
_
2t-Proesslngtocrterle
t_- era towenees
aitproprite oneo oscabulary. Generally aceptable oeof Vocabularyislimited Useof
Poo, -ocabulary andcooror
o
rl~o~rat
ue f trlnian, tem
oabulary and Iecfhia
teincltnsand phrass are1 inappopriate use ofltechnical
I|
m
7
Main points am not
LANGUAGEi VOCABULARY _
3 -Meets CrIteria
Srz
I
lntrodurdion, body, 6 condusion Indudes introduction, body, Introduction S condusion are cot
are dearly delneae.td. Pvices aS conldusion.Shows abilit
dearly presented, Some
I Mdacgd
andy
.
[a dear summaryof proec,
to summaize._
eniderce of summarization.
condusion nummrna rezmissing
4Enceds Crtele
ofi
|_
t
for
Tot-l
hbotin geerally lacing
m
~~~~~~~presentyd.
TransiToonsare generally
_! !giocaland smooth,
een
_
somneonganizabonis attemptesd,Lid
logically 3 sequentially.
I
_
_
lesstehandesirable P
terms and obrases,
-_
_
_K
70
0
Total
F#Of[-
Scae
Stres
Ip
230
I1
nesiess
~~~attro.
I Neat,csu
lof standard tnglinb.__
IN at casualattre.
____ne;lino.
I
I
………
Atir Aappearance
inapprepriata,
toeinformal or
3.03
60~
g rtrddrd
nerally
flioms roles
forGenerally
doesnlotollom
rulesDos nottoflom
rolesofstandard2
Rnglish.
3.94
-
F
Select a result type or reset to end
SelectresulttypeIMann
rSUBMI
F
~i.|CEL
Figure 15. Data analysis - mean result type
When the result type, Median, is selected, the application displays the median value for
each criterion. The median value is the value in which there are an equal number of
values above and below it. An example display of this result type is shown in Figure 16.
21
s
Ek
i
IQ
e yi
*
lode
~
-
*~~~
dt 5 lliy
-
~ ~~~
-
,
-b lity bb
.
.
-
- -- -_-|||||
h-.
begins he-
Mli-ion I G.aia I Cbjectio7
Ij
,,
II
SACRAMENTO STATE
Ld-hip
.
-
.
9
go
I Out-omes I Perfersenee Criteri I Asses.ment Plan I ealuabon I Legin I tegeut FacuIty
Computer Science Program
Houme
Public
i
Faculty
View Eyaluabon Data
Analysis
i
Data Results
l1
1t=
iStudent
Learing utcome
I fiAnabilty to communicate eff ecbely with a range of audiences
', |-_
Ceune_________ourse
i 190 SeniorProject Part I
.l~pnng
2gte
Semester &Year
I[
|Computer
Stence
_
__
_
_
_
Oral Communlcation
_
___
Medin
4 -tEoceeds
A
Critierto _2_ 3 - MeetsCriteria
||_2 - Prorressing to Criteria
Organizescontentlogicallyand
Generally
organizescontent Someorganization
is attempted,
i | sequentIa
y ___
nllically&
isnquentally.
but is generally lacking _
Mainpointsare clearlyidentied
andcociselypresented,
I!
g._
medlan
ORGANIZATI[ON
ore
Main
generall
identified
and
adeqoatyly
points
Manpitaeno
-
ITrsitons are generally jand
Many
transitions a'enotlogical
smooth.
logical
andsmooth.
1 Trasitonsarelogcalandsmoth,
_
i
- 8elo Eop
t c__n s
ide
of gn t
i Mmpitsre
n--nt
isng
iig
Mosttransitions are abopt or
missing,4
i Inbodudtin, body, &
condusionare |Indudes inbodudbon,
body,b IntrodochonS conclsion are not
Introducton
and/or
cdearydelineated. ProWides
aa
condosionShomsabilityto dearlypresented. Someenidencoe cfsmo/surmary a. missingo
dearsummary of pnoject
_ sommarize.
_ __ _|of summazation.
iE
4 -Esiceeds
Cr-leri-
ii
i
i
i
i
i
1=3 -MeetsCriteria
2 - Progressing to Cditra
Appropriate
oneof ocabularn.y Generally
acceptable
useof Vocabulary
is limited.Use 0f
Ilyocablaulry
,'-raeof tch'ncal
us
Itechnical termsandphrasesare
andtechnical
OAccurate
useof technicaltenms
termsandphrases,
lessthan desirable,
-cnicnlyflosrles
of
,Gneal
follow rles for
11Generally
doesnot followsalesoy
standardenglish.
- stariard" tngish. _
standardEnglish.
i |
_ _
_
_
_
____
__PER
_4- ExceedsCritleie
-MastsCriteria
i
j_ 2- Progressing toCriter__
~~~~~~~_
Neut,profesianulbusiness attire.
IL -
i SeLect
i
U~~~~~~~~~LNGUAGE
&1
VOCABULARYj
=
I
I -Below
E.pectatloms
Poor,ocabulary
andPooror
inappropriate
oneof technicaltoers
andphrases.
4
Doesnot folow colesofstandard
English.
d____
I
_
_
BelowExpections
i
~~~~~~~~~APPEARANCE
_
_
_
Ne t,casualbusinessate
-J Neatcasualatire
-
r
.
l re
a appoearance
tooinformal
_or
~~~~~~~~~~~~~~~~~~~~~~~1inappropriate.I
a result type or reset to end
Selectresult typelMen.
FiSUMIT. F ESET F6iCFL|
I
=
-
Oeln.,.15y.
SaO~m.05o
l-Coeoi5O..5 I
O~o.mnrto.COesusslr0e
2-ne-uo
±
-2I
Figure 16. Data analysis - median result type
When the result type, Mode, is selected, the application displays the mode value for each
criterion. The mode value is the most frequently occurring score value for a given
criterion. An example of this result type is shown in Figure 17.
22
td
A_. SACRAMENTO
Ldt
biem Hrey
goks,
5*
STATE
Icd5 bosmtay
g.
rdiSACRAMENTO STATE
_-h
ieoLd-nhipoeg~hshe
I
9
go
fiSsion I Goals I Objectines I Ontc.mes I Performance Cntena I Asses.meet Plao I Eoluation I Loom I L..o.t Faculty
i
i
Home
Computer Science Program
Public
I
Faculty
Vie Enaluation Data
Analysis
i
Data Results
[
10
Student Learning Outcome
I anabiityto
ornuniataettodyltwbba range of audiencers
SeniorPoject
*
i
art I
Semester &
Year .
i
!(
Computerd
_______
_
_ ____
4 - ExceedsCtierla
3-M
organi
es con ent o icaty
Transitions are logical and
smooth.
_
body,6
cndusion are clearly
|Introduction,
ts Crteria
Generallyorg
anize
~
and senuontialin,
Main points are dearn
identfied and concisely
Pesented
=
= Orl_C-s unIcion
ORGANIZATION _
______
j
content logically S
sequentialil.
Main points are
' generally identified and
danuately presented.
loicalandsmooth.
.
Shosability to
summarize.
i Appropnate use of
s
tecnablarmAcchaical
inotdearly presented Some
eidenco of summanzadon
3-
Meens
C ri
Z P
n
i
4
4
Most transitions are abrut or
missin_.
1
4
17
4
2-or
'
16
Neat casual busness
attire,
o
casual attire
5
---
condusion/sum.maryane
missng
Robe.Eapec gloos
SSco
Poor -ocabularyand poor or
inappnoipate use oftechnical
terms and phrases.
1b
of
,
0|-
Generally aneptable
Vocabulary is limited, Use of
tenon and
technicaltermsandphrases
tedhniral terms |phrases,
are less than desirable
d
attir e.
17
te
i
i
i lConsistently folos rulesof 1Gnnerlly follo.s roles Generally
doesnot follo,
i
standardEnglish. _
_
forstandard English.
roles ofstandard oliEsh.
i
i
i
iAPPEARANCE
i
8Neat,frofensionalbusines5
Main points are mising.
1 VOCABULARY
J
F
otoganizn
-
looal and smooth,
de
=
~
Iattempted, but is qenerally itte-id.n
c
Main points are not
_
o eciel'. Enee nitos
Scares ||r de2 Freq ency
u t e e i e c f o g n o n4
1
ISomeorganiza tbon is
lacking.
| _
_ot
Inddudes
introduction |lntroducoion B condusionare ,Introducoon andlorr
body,,
&condusion.
I f-LANGUAGE
i
!t |
ITransitions
am generally Many transitions are not
delineated. Proides a a
ldearsummary of project.
*-EuceedsCrinierie
Pror rr tsixoto C
__
_
Mode Frequency
-
55
il4
50
Doesnotfollo rolesof
estanda
E
es
_
J
critri
e of
Sres lodeFreq
ANeat Saperance tooi
info
rmal or
__
in a ro t t e
Select a result type or reset to end
i
i
i
I
Selectresult type |sleon -SU5MTFFRESET F4FI
Figure 17. Data analysis - mode result type
When the result type, Percentage, is selected, the application displays the total number of
scores for each criterion followed by the percentage of the score values. The percentage
is broken down into the percentage of score values equal to four (%4), the percentage of
score values equal to three (%3), the percentage of score values equal to two (%2), and
the percentage of score values equal to one (%1). An example of this result type is
shown in Figure 18.
23
_en fdt H
a
s
fn-n
Sl
ie
s
teds
b-bom y
UO
SACRAMENTO STATE
L-rdenhipbeginsh-rs
E
1
Missies I Goels I Objectiens I Out-omes I Perf-n-ense Cntena I AssessmentPlan I EfWoe.Un I Login I L...ut
Home
Computer Science Program
Public
Data Results
Faolty
View Evaluation Data
Analysis
Fculty
Isturleet LearningOutcome_
A, _abiLty_
bommunicat offectiely witharange of audience
|I __
__
en~ourse
_
1190 SeniorProject partI
~ ~
I!
1.
__
_
&Year
_-- Semester
Computer
Scioenc
_j
Oral Communication
Perteotaae
ORGANIZATION
]
4 EacoodsCritleile
3 MeetsCiteria
rganizes contentlogically
antequnhally.
enerll oraie
Transitions are logical and
smooth,
oraolg
's
to Crlteria
I - BelowEolsectatlens
idontyifidand
onsaent
Mai
Min Pointsaremissing.
Mosttranitio
- msng .
rn abrupt
Introduction body, B
Indudes introdut Onl
In
nldeinnatod.
Prooidos a a
doearsummarYof papbct.
So ws ability
summanzeI
Inetde c
sn t
scondue
ro nu mma/r ar
eidence of summariation
missmg|.
cndsion arecdearly
BoAcondusion.
on
ducon
l
du
4 - eceeds Critleria
_______
_i
3 -Meets Cr100
2- Pr_
go Cwra
on
94 6
I
,94
e o
_EPert
c
|__
j0
_
0
_[
,
6
_
|sScores
~~~~~~~~~~~~~use
in~~~~~~~~~~~~~~~~~~~~~~~~~~~~pp~~~~~~~~~~pr,
oftechnical 60
9
andt oo9o__
Generally dons not follow
saules of standard English
Does not follow rules of
j standardpEnci
too
_nglish
APIPEARANCE
4- E.-ds Crtlerla
[
tenalacecbesvchabolardishmid-
Consistenty follows nulesof Generallyfollows rules
standard English.
4for standard English.
|-
.
a
I -Below
s
i-cabulary. Accurate,oo
0
oo
-
____.__.phrases._
__
18
o
di~ ndo
LANGUAGE&VOCABULARY
l
ca
Litre oidenceoforganizabon
j adequately presented.,
Transitons are generally Many transitions are not
logical and smooch,
logical and smooth.
Id_
Scrs
-
attenrmt d, but is geneay
Main points are generally |
identifid andconuisely
presented.
-
Someorganizahun
is
h
Main points are dearly
_
-_-
If'eat, pressional business ,|fitea caulrsns
j
|Nacsultn
car~oes
*_Blw Fr.PitRt
1
'|~nn
p
oernce
i1
_
t4|3l2lI
7kig
Select a result type or reset to end
Select result typo | Meen_ _ i
F SUffI`T | I PESETI
F
L
j-
Os
')
u
,
Isa..
n
I =.
.-
-a
|NCEL
-
I1
Figure 18. Data analysis - percentage result type
When the result type, Raw Data, is selected, the application displays the raw data. This
includes the criterion ID and name, instructor name, team ID, date, evaluator type, and
score value. An example of this result type is shown in Figure 19.
24
wand
snow mm
Ei
le
OdR
Dew
Hl1orY
Woohrk
Ro
om
m .
-
-
m
&
W
RIMIRe
|
Mr U
-0
U
-- -
-
or
-
9 SACRAMENTO STATE
'I
,; <
ie.h
Leadershipbegins here.
0-
CX1
- D-- -est
- -- - l
o
39
eh|
Mission I Goals I Objectives I Outcomes I Performance Criteria I Assessment Plan I Evaluation I Login I Logout Data Entry
Home
Public
Data Entry
View Evaluation Data
Enter Course
Information
Update Course
Information
Enter Team
Information
Update Team
Information
Prepare Evaluation
Form for Print
Enter Score
Information
I
Computer Science Program
Data Results
_Student Learning Outcome
j
If .An ability to communicate effectively with a range of audiencesJ
Course
1190
i
Senior Project: Part I
Semester &Year
{
|
Iptring 2008
List of Raw Data
FCriterion
|1
ID| Criterlon
Name|cnstrutorj|TeD |_t
Evaluator Type
|re
25, 20081taculty
__Buckleyj|a
Buucklev
ck
|I
l|fl
FI
-117|B-uc-kiev
I
fi-
ISeo 25. 20013j acultyI
Fsen
~25,
2oo-sll fac-uity
iF4
Figure 19. Data analysis - raw data result type
2.3.
Data Entry
The data entry view has restricted access and requires a login. This is a single username
and password that will be shared with all data entry personnel. There is also a
corresponding logout option when the data entry user is finished using the tool. Both the
login and logout links can be found in the right hand side of the horizontal navigation
menu. The intention is to have information added, deleted, or modified by data entry
users. In addition, the data entry users prepare and print out evaluation forms. Since the
data entry users add, delete, and update entries, it is important to know that the
application provides a cancel option before any item is deleted or modified in the
database. If in doubt, use a link in the vertical or horizontal navigation pane to change
functions.
25
2.3.1
Objectives
The data entry view for objectives includes the ability to view, enter, and maintain
attachments and objectives. The Maintain Objectives link in the vertical navigation
menu allows the user to add a new objective by entering the objective number,
description, and clicking on the submit button. The Maintain Objectives selection also
allows the user to update a specific objective. Each objective is listed with editable
objective number and descriptions followed by update, delete, and cancel options. The
update button updates the information for the specific objective information to the left of
the update button. The delete button deletes the specific objective after the user
confirms the deletion request. The cancel button reloads the page with the original
information. An example of these features is shown in Figure 20.
jn
A
a
Hitrdit geresn
Ftmy
lItook
ccs(# ty
t
:i
SACRAMENTO STATE
go
I
Minalen
I Goals I Objectives I Ontmnmen
I Per.orm
Home
Department
Objectives
College
Objectives
University
Objettives
D ctivEntry
Data Entry
Maintain
Objectives
View
Attachments
Enter
Attachments
Maintain
Attachments
e CrIteria I Assessmen.tPlan I EnalUatlon I Legin I Lgout Data Entry
Computer Science Program
Program Educational Objectives
Add Nw Ob
Ajectve
Enter the objective number
Enter objective description
Add objective
=ubmilj
update Objective
objective
[T7l
F77"
Description
To be a significant contributor in one or more of the aepects associated with the 1UPDATE
development. maintel.a.ce
and support of real world computing system.
DELETE
ITo be
an effective and contributing member of a project team.
Figure 20. Data entry - maintain objectives
26
The View Attachments link displays the attachments. For details on viewing
attachments, see section 2.2.1. The Enter Attachments link adds new attachments. The
data entry user uses the file browse button to upload an attachment given that the file
requirements are met. Next, the user selects the associated objective(s). This may be
one or more or all of the available objectives. An example of entering an attachment is
shown in Figure 21.
De D
to fitsMm
Nabns
looa
itelpb
Uo SACRAMENTO STATE
{
h[
Leadershipbeginshem!.
is..ion I Coals I Objectives I Outcomes I Pertoracce criteria I Ansessmect Plan I Evalcatico
g
I Lo1oot Dats Entry
Computer Science Program
Home
Public
Attachments
Upload attachpment file
Department
objecthnes
CollegeObjectnes
*
Loi
go
UniversityObjecties
Data Entry
MaintainObiuiocnes
ViewAttathments
Enter Attaciments
MaintainAttaihments
Uploadfile
FC~aocummen
ts andSeoi Proso...
Thefile requirements are:
. Filesize: < 2MB
. Filetypes: pdf
Se/ect the objective(s) that is(are) associated with the attached file
ir
Tobe a significant contributor in one or moreof the aspectsassocattd with the development, maintenante, andsupport of realworld comouting
systems.
:To be an offectiveandcontributing memberofa project team.
r
To be continuallyengagedin the pursuitof professional
development
opportunities, and/or pursuepostgraduate studies.
;To assumea leadershiprolein their chosencareerandprofession,
FTo demonstrate competence
in produing highquality written documents,
and is reviewing and revisingthose prepared by others.
lTo
demonstrate competence
in developing
and deliveringtechnicaland non-technical presentations of highquality to a variety of audiences.
F To abidebythe ethicalstandardsof the professionandunderstand the socialimplications
oftheir professional
activities.
Select the checkbon
to select allthe obj-ctoos F`
FsuBmrr
-
=
-Cioma00.
unorv. Laaat
F~sittrv F~i~6ciK
I SOJSaSIOamno
osesI1c)oeco
Figure 21. Data entry - enter attachment
The Maintain Attachments link in the vertical navigation menu starts with a drop-down
menu allowing the user to update or delete a selected file, as shown in Figure 22.
27
I SACRAMENTO STATE
-
go
Leedship begins hee.
1
1
NSnsainI
~oa.I.
I Obje-tie
Homse
P-obfliE
Department
I Outcomes I Pe-for
-ane
Crtorier I A ssessent Plan
..
I
nluaton I Login I Lngot Data Entry
Computer Science Program
Select Attachment
Objectives
College Objectives
University Objectives
Dote Entry
Maintain Objectives
Jiew Attachments
Enter Attachments
Maintain Attachments
Attachment HP-Visit-Fel0Bpd
18, 200b8)
F DELEI
Cal.fmla stateUnivesf. S.ram..nto I 6000 J Stnat I S e
nto CA95e8s 1 (9161 270-0011
Figure 22. Select attachment
When the delete button is selected, the specific attachment is deleted after the user
confirms the deletion request. When the update button is selected, the file information is
displayed followed by a list of objectives. The existing association(s) is preloaded and
then the user may modify the selection as needed. If the attachment is associated with
all the objectives, then the checkbox at the bottom selects all of the objectives. The
update button saves any changes made. The cancel button returns the user to the select
attachment screen. An example of updating an attachment is shown in Figure 23.
28
;e
Eck pt.
Hlon
Ic5d
I.n
ll
&gP
SACRAMENTO STATE
s
nLedershpbeginshere.
mi.sionI Goals I ObjecUvesII
I Pto
erfonnce Criteria I Assessment Plan I toaluation
I
o-rdi
go
.ogin
I Logout DOatEnter
Computer Science Program
Home
Public
Department
Objectives
College Objectives
Update Attachment
File Name
Date Added
HOct
18,2008
University Objectives
Data Entry
Maintain Objectines
View Attachments
Enter Attachments
Maintain Attachments
Date Last Modified
iOctobar 18,2008
l
Select the objective(s) that are associated with the attached file
flTo be a significant contributor in oneor moreof the aspectsassociatedwith the development, naintenance,
andsupport of realworldcompurtin
systems.
R To be an effective andcontributing memberof a project team.
flTo be continually engaged in the pursuit of professIonal development opportunities, and/or pursue postgraduate studies.
P To assumea leadership roleinthoIr chosen career andprofession.
I"To demonstrate competencein producinghigh quality written documents,
and Inreviewing and revising those prepared by others.
iiTo demonstrate competenceIndeseloping anddeliveringtechnicaland non-technical
presentations of highquality to a variety of audiences.
ri To abidebythe
ethicalstandards of the profession and understand the socialimplications
of their professional activioies.
=
Selectthe checkboxto select allthe objectives Ci
r b\ ;;EE PP - XCalforna anar Unls~ss.O.s7msno
0
0o
ba[ri I
amenno, Cucsats
-
1 006) ..e-.. .
Figure 23. Update attachment
2.3.2
Outcomes
The data entry view for outcomes includes the ability to enter and update outcomes and
update the objective-outcome matrix. The Enter Outcome link adds a new student
learning outcome. To enter an outcome, the data entry user enters the new outcome
number, selects the outcome source (e.g. ABET, CAC, etc.), types in a description, and
clicks the submit button. The next sequential outcome number is automatically entered
into the outcome number when the page initially loads. The user may modify this
number as appropriate. To assist the user, the current outcome tables are listed at the
bottom as a reference. The outcome number is listed as both a number and letter. This
assists the user for outcomes are displayed as letters to the public but entered as a
29
number into the database. An example of the enter outcome page is displayed in Figure
24.
0
Edtw
ik
E
tie
a
gt"m
sDo-lV (I1m &-Eft
tb*
SACRAMENTO STATE
rxh
Leadershipbeginshere.
Mission I Goals I Objectives I Outcomes I Perfoemance c0iteria I Assessment Plan I Evaluation I Login I LogeGt Data Entry
Home
Computer Science Program
Public
Department
Outcomes
Student Learning Outcomes
College Outcomes
University Learning
Goals
View ObjectiveOutcome Matrix
View ObjectiveOutcome Table
Add New Outcome
Enter the outcome number 15121
Enter the outcome source fABET
,
Data Entry
Enter Outcome
Update Outcome
Update ObjectiveOutcome Matrix
Enter the outcome description
I
-
_-
-
-
--
i
IsuBMIT I 1RESET I CANCEL |
ABET Student Learning Outcomes for Accrediting Computing Programs (What students are
f-Ite tn &n.,
-e
At tinw
nf n-r
-tAatn
Description
Outcome
1(a)
2(b)
3(c)
An ability to apply knowledge of computing and mathematics appropnate to the discipline
An ability to analyze a problem, and identity and define the computing requirements appropriate to its solution
An ability to design, implement, and evaluate a computer-based system, process, component, or program to meet
x desired needs
4()An ability to function effectively on teams to accomplish a common goal
5(e)
An understanding of professional, ethical, legal, secunty, and social issues and responsibilities
6(f) An ability to communicate effectively with a range of audiences
7(g)
An ability to analyze the local and global impact of computing on individuals, organizations, and society
8(h)
Recognition of the need for and an ability to engage in continuing professional development
A9()
in ability to use current techniques, skills, and tools necessary for computing practice
CAC Stu dent Leaming Outcomes for Computing Sdences
Out ome
Description
JAnability to apply mathematical foundations, algorithmic principles, and computer science theory in the modeling and
design of computer-based systems in a way that demonstrates comprohension of the tradeoffs involved in design
choices
11(h) An ability to apply design and development principles in the construction of software systems of varying complexity.
IO(j)
i
i 6OOO3
Street I s
Califorxo Stat. tlmvesxv. 5ao-om~ten
ramento,CA958s9 1 (916) Z78-60u1
.
Figure 24. Enter outcome
To update an outcome, select Update Outcome in the vertical navigation menu. The list
of outcomes is displayed. Each outcome has an editable outcome number and
description as well as a drop-down menu of source options. This is followed by update,
delete, and cancel options. The update button updates the information for the specific
outcome information to the left of the update button. The delete button deletes the
30
specific outcome after the user confirms the deletion request. The cancel button reloads
the page with the original information. An example of this feature is shown in Figure
25.
El-E
int
r
1mAc
&-lSet Y te
gDos
ftar
OSACRAMENTO STATE
Leodernshipbegins
here.
MissionI GoolsI ObJ-etivesI Outcomes
I Performnece
Criterno
I Assessment
PinnI Eeinetion I LoginIougat DntaEntry
Home
Public
i
Computer Science Program
Department
Student Learning Outcomes
Outcomes
CollegeOutcomes
Update Outcome
University Learning
Outcome
Vie. Objectiveoutcome Matrix
ViewObjectiveOutcome Table_
Dote Entry
Enter Outcome
Update Outcome
Update ObjectiveOutcome Mathn
Source
Description
F78ET -
An ability to apply knowledge of computing and ethenticin
d~acipine,
_
il__ j
IABET
_
An ability to aneiyseapnnblnn, and identify and define the
re_-uireneents
_ __appropiet to it.s solution
FT
-
F
_J
ppr
to
TE
_I DELETE
CANCEL
__
An ability to denign, inpleen., and elute a coputer-beed
or progom to nest deired needs
Y
-oryputing
yte,
FUPDATEI
DELETe
proces,
UPOATE
_tELETE
_
tC.ANGEL
-BET-.o.po..nt,
_ -_--_ ___
_
_
Figure 25. Update outcome
The Update Objective-Outcome Matrix option walks the user through the process of
updating the association of outcomes to objectives. The first step is to select an
objective and then click submit, as shown in Figure 26.
_
31
.La
Bt
W-V
e
1EeIods
'ce
yI.
*
lOSACRAMENTO STATE
i
hi
... nh
tw~er~hovioin~hee
earch
[
1Ea
MissionI Geels I ObeciJees I Outcomes I Performence Criteri. I Assesseent PIen I toatntien I L.nle I L.Ueut Dote Entre
Home
Computer Science Program
Department
Select an objective
Outcomes
Object"ee
Colmege
|:To e a significant contributor in one or more of the aspecs associated with the de.elopment, maintenance, and support of real wodd computing systems.
University
Leaming
Goals
F SUBMIT | |RESET |
FX
C
EL
Viee
ObjectiveOutcome
Matno
V'em
ObjectjueOutcome
iTable
Date Elnty
Enter
Outcome
Update
Outcome
Update
objectiveOutcome
iMatri.
L_
C-fezldftsnnmverednShee"Tnr
I 600
SSetI S!emente, CA 9S:9 gus) 27096011
1
Figure 26. Update matrix - select objective
After the objective is selected, a checklist of corresponding outcomes is displayed. The
existing correlations are already selected. The user can then update these selections as
appropriate. The submit button saves any changes. The cancel button reloads the page
with the original settings. The reset button goes back to step one, "Select an objective".
An example of the second part of this process is shown in Figure 27.
32
0
fc Edt Vne Hll-
_-
Bdskl
Tk
Aeslv
Acsts
Ho1s
SACRAMENTO STATE
.noeh
_
Leodershipibeginshere.
Mission I ools I Oblsectses I OnutwmesI Pertoonnme Criteria I Assessment Plan I Evsluation I Leoin I Lormet Date En"tr
Home
Computer Science Program
Public
Department Outcomes
College Outcomes
University Leaming
Goals
View ObjectiveOutcome Matix
View ObjectiveOutcome Table
Objective Selected
Date Entry
Enter Outcome
Update Outcome
Update ObjectiveOutcome Matri
objectivel
Descriptlon
1
To be a significant contributor in one or moreof the aspects associated with the development, maintenance, and
support of real world computing systems.
Check the outcomes that apply to the selected objective
F" An ability to apply knowledge of computing and mathematics appropriate to the discipline
R An ability to analyze a problem, and identify and define the computing requirements appropriate to its solution
17An ability to design, implement, and evaluate a computer-based system, process, component, or program to meet desired needs
R An ability to function effectively on teams to accomplish a common goal
IT!An understanding
of professional, ethical, legal, security, and soci
issues and responsibilities
An ability to communicate effectively with a range of audiences
A
E An ability to analyze the local and global impact of computing on individuals, organizations, and society
r J Recognition of the need
P
for and an ability to engage in continuing professional development
An ability to use current techniques, skills, and tools necessary for computing practice.
I An ability to apply mathematical foundations, algorithmic principles, and computer science theory in the modeling and design of
computer-based systems in a way that demonstrates comprehension of the tradeoffs involved in design choices
PrAn ability to apply design and development principles in the construction of software systems of varying complexity.
FSUBMW I| RESET
1
I
CANCEL
I
CalifomiaStateU,,i.... ity, amomimt 16000 3stet I S.tamento, CA900101(916)270.6011
Figure 27. Update matrix - update outcomes
2.3.3 PerformanceCriteria
The performance criteria section is where the criterion, criteria-categories, and rubric
forms are managed. Data entry users can view the rubric forms in the same manner as
faculty users. For more information, see section 2.2.2. The View Criteria-Category
link allows the user to view the various categories. To view the criteria-categories, the
user first selects the rubric form with which the categories are associated. If the users
want to see all the existing criteria-categories, then the user selects the checkbox noting
all of the rubric forms. Once the rubric form is selected, then a list of categories is
displayed as shown in Figure 28.
33
oes .w.
.toy
Ei'e' llS~l~llEsfi-1.
el
.11
Edle Edit Vlew HWtory &Iarks
lrools
I
&ccressblity
U'-
-
' --
.
=-_;
.
telp
SACRAMENTO STATE
Search
Leadership begins here.
|go
Mission I Goals I Objectives I Outcomes I Performance Criteria I Assessment Plan I Evaluation I Login I Logout Data Entry
Home
Computer Science Program
Public
View Criteria-Category
Data Entry
View Rubric Form
Select a rubric to view the associated categories
View CriteriaCategory
Select rubric |
Orarounicabon
IJ
View Criteria
Select the checkbox to select all the rubrics IZ
Start Rubric Form
! SUBMIT
Update Rubric Form
Maintain CriteriaCategories
Enter Criterion
Update Criterion
r
Oral Communication
ID
1
2
3
4
5
FRES-TI
CANCEL
I
Category
ORGANIZATION
STYLE &DELIVERY
LANGUAGE &VOCABULARY
APPEARANCE
COMMUNICATION OF TECHNICAL CONTENT
California State University. Sacramento
6000eo
J Street I Sacramento, CA 95819 1 (916) 276-6011
Figure 28. View criteria-category
The View Criteria link in the vertical navigation menu displays the criteria associated
with a specific criteria-category. To view all the existing criteria, the user uses the
checkbox selecting all the categories. For example, in Figure 29, the category, Language
& Vocabulary is selected.
34
WMQM.IIFIG~~
~ ~ ~~
Eile EdieOe FWry
Eeelovars Jos
~ ~ ~ ~
&ccessWty b*
,KISACRAMENTO STATE
-
I
Ash.
Lederhip begins here.
MI oxiec
rI m
Msio Gol
flhl"tli,~. ;oal.I lmni.IP.n..n.tlel
nIe tive
O
.. I Otcoes I P.,form.nce Criteri
.0InI
I Assessmen.t Pi..
I
F.M.-H..o
I im
Lrin I ogout not.
go
F.tr
Computer Science Program
View Criteria
Home
Public
Data Entry
View Rubric Form
View CriteriaCategory
View Criteria
Start Rubric Form
Update Rubric Form
Maintain CriteriaCateories
Enter Criterion
Update Criterion
Select rubric category APPEARANcE
_
_
Select the checkbox to select all the categories EJ
|SUBMIT |I
Criterion
Name
_
ESET
CANCEL |
LANGUAGE &VOCABULARY
Exceeds Criteria
Meets Criteria
Progressing to Criteria
t
f
Generally acceptable
Vocabulary is limited. Use
Appvopab e use o
use of vocabulary and of technical terms and
use of technical terms technical terms and
phrases are less than
______
________________phrases.
Consistently follows
rules of standard
<
-
d~esirable.
Generally follows rules Generally does not follow
for standard English.
Irules of standard English.
English.
u
state UnlWjrrity, S.-!M.n
~~~~~~~C.Ilf-ml
e
! 6000J Str..t I S-cr-M.,t
Below Expectations
Poor vocabulary and poor
or inappropriate use of
technical terms and
phrases.
Does not follow rules of
standard English.
Rating
Type
individual
ndividual
idvda
I
CA 95019 1 (916)
27G-6011
Figure 29. View criteria
For a new rubric form, select Start Rubric Form from the vertical navigation menu.
The user is then walked through the process of creating a new rubric form. The first step
is to select which outcome with which it will be associated. The second step is to enter a
title for the rubric form. To assist the user, a list of existing rubric forms is displayed at
the bottom of the page, as shown in Figure 30.
35
..
Wey
Be
Edt
aE
I
B
Jkr
Teodsae~ssy
X3
tl
SARAMENTO STATE
Leadership
begins here.
___
Mission I Goals I Objectives I Outcomes I Performance Criteria I Assessment Plan I Evaluation I Login I Logout Data Entry
Home
Public
Data Entry
View Rubric Form
View CriteriaCategory
View Criteria
Start Rubric Form
Update Rubric Form
Maintain CntenaCategories
Enter Criterion
Update Criterion
Computer Science Program
Start New Rubric Form
Step 1: Select an outcome
C a:An ability to apply knowledge of computing and mathematics appropriate to the discipline
C b:An ability to analyze a problem, and identify and define the computing requirements appropriate to its solution
C c:An ability to design, implement, and evaluate a computer-based system, process, component, or program to meet
desired needs
rC d:An ability to function effectively on teams to accomplish a common goal
r e:An understanding of professional, ethical, legal, security, and social issues and responsibilities
f: An ability to communicate effectively with a range of audiences
: g:An ability to analyze the local and global impact of computing on individuals, organizations, and society
c h:Recognition of the need for and an ability to engage in continuing professional development
i: An ability to use current techniques, skills, and tools necessary for computing practice.
C j: An ability to apply mathematical foundations, algorithmic principles, and computer science theory in the modeling and
design of computer-based systems in a way that demonstrates comprehension of the tradeoffs involved in design choices
C k: An ability to apply design and development principles in the construction of software systems of varying complexity.
Step 2: Enter the title of the new rubric form
Enter the title of the rubric for the selected outcome
|SUEMrF
I|RSET!| FCCELI|
|
Rubric Tites
1121
Topic
ilOutcone
;jIOral Comunication I
(f)-Fj
DjjWritten CommunicationlLf{JI
Behest rubric
(a) _
(
C.1lfom-I Stt. U.1-ultV, S.-wmneto
! 60003 Staet I Sa.ram.nto,
CA 9s589 1 (916)
27e-6o01
Figure 30. Start rubric form
If the rubric form information needs to be modified, then use the Update Rubric Form
link in the vertical navigation menu. The user first selects the rubric form to be modified
from the drop-down menu and clicks submit, as shown in Figure 31.
36
Fae
Edt
ew
|^
iHigtory ElkW-im
]ols
Accessiblty
Uep
SACRAMENTO STATE
go
9e0h
Leadership begins here.
Mission I Goals I Objectives I Outcomes I Performance Criteria I Assessment Plan I Evaluation I Login | Logout Data Entry
.
Home
Computer Science Program
Public
Update Rubric Form
Data Entry
View Rubric Form
Select rubriic
c
i
View CriteriaCategory
Oral Communication
vEST
View Criteria
Testrubric
ionj
T
Start Rubric Form
Update Rubric Form
Maintain CriteriaCategories
Enter Criterion
Update Criterion
California State University, Sacramento 1 6000 J Street I Sacramento. CA 95819 1 (916) 278-6011.
Figure 31. Update rubric form - select rubric
Once the rubric form is selected, a page that allows the user to modify the title and the
associated outcome is loaded. The submit button saves any changes. The reset button
returns the user to the first step of selecting a rubric form. The cancel button reloads the
page with the original information. An example of updating the rubric form is shown in
Figure 32.
37
Bl
Fdt
!
yew Htvory Qsa
toris &Acicty Hall
SACRAMENTO STATE
go
Leadership begins here.
Mission I Goals I Objectives I Outcomes I Performance Criteria I Assessment Plan I Evaluation I Login I Logout Data Entry
Home
Computer Science Program
Public
Update Rubric Form
Data Entry
i
MVew
Rubric Form
| ew CriteriaCategory
Mew Criteria
Start Rubric Form
Update Rubric Form
Maintain CriteriaCategories
Enter Criterion
Update Criterion
RubrIc Pen ID
2
|Title
IWnoen
Communic-bon
Select the outcome that applies to the selected rubric form
r; a: An ability to apply knowledge of computing and mathematics appropriate to the disopline
C b: An ability to analyze a problem, and identify and define the computing requirements appropriate to its solution
C c: An ability to design, implement, and evaluate a computer-based system, process, component, or program to meet
desired needs
C d: An ability to function affectively on teems to accomplish a common goal
0: An understanding of profosslonal, ethical, logal, security, and social Issues and responsibilitios
, fi An ability to communicate effectively with a range of audiences
C g: An ability to analyze the local and global impact of computing on individuals, organizations, and society
h: Recognition of the need for and an ability to engage in continuing professional development
r i An ability to use current techniques, skills, and tools necessary for computing practice.
l j: An ability to apply mathematical foundations, algorithmic principles, and computer science theory in the modeling and
design of computer-based systems in a way that demonstrates comprehension of the tradeoffs involved in design choices
r k: An ability to apply design and development principles in the construction of software systems of varying complexity.
lSUBMIT | iRESET | FCANCEL |
stt uvi~s~ltv S~aavsnI 600oJ Str..t | SacI.mento,
Culkfo.mi
CA 95819
1(916) 270-6011
Figure 32. Update rubric form - modify form
If a criteria-category needs to be added or modified, then use the Maintain CriteriaCategories option in the vertical navigation pane. When selected, the top half of the
page is a form for adding a new criteria-category. The user selects the rubric form with
which it will be associated, enters the name of the criteria-category, and selects the
submit button. The cancel and reset buttons reloads the page. The bottom half of the
page is a separate form which updates or deletes a criteria-category. The first step is to
select a rubric form. To select all the rubric forms, use the checkbox. Once the rubric
form is selected, a list of criteria-categories is displayed with an editable field for the
criteria-category name. Next to each criteria-category name is update, delete, and cancel
buttons. The update button saves changes to the criteria-category name. The delete
button deletes that specific criteria-category once the user confirms the deletion request.
38
The cancel button reloads the page with the original information. Figure 33 displays the
form to add a category and the process for updating or deleting a criteria-category.
El-
rt
9b
wo tBoolria oo te
I SACRAMENTO
!
e.lship
-
MMiu.io I
Goul.
.J-
H*
STATE
go
I Objocti-nu I Outcome. I Per-fo-n-n Criterl I A..e...nent Plin I E.eWuntion I Login I Logoot Dut. Entry
Home
Public
Data
beginshem
y
Publc
DataEntry
uitewRubricForm
ViewCriteria-__
Category
VoewCrteria
Start RubncForm
Update Rubric
Form
Maintain CriteriaCategories
Enter Criterion
Computer Science Program
Enter Category Information
Step 1:
Select tlhe rubric fort75
Select ubricj
_ _ _
_ _ _ _ _ _
Corrmnmcuoo
J
Step 2: Enter the criteria -category title
Enter a category for the selected rubric
I SUBMIT | RESET | F|
CEL|
Update Criterion
Update Category Information
Select a rubrk to view the associated categories
Select rubric |On Communicntion
Select the chedcboxto select allthe ubrics1I
irSUgMIT FtEScT
|
CANCEL
|
Category
RubricTitle
UtDATE
DELETE
ORGANIZATION
Oral
ConmmunicatlonL_----
-----
DELETE---
-- ------
CANCEL
UPDATE
Communiubo
_
.
ET-YLE
&DELtVEY.
_
DELETE
CANCEL
UPDATE
ommunicra
o
_
_
_
_
_LANGUAGE &VOCABULARY_
DELETE
CANCEL
UPDATE
Communicarol
_A
ANCE
Oral
COMMUNICATION
OFTECH-NICJAL
CONTENT
Communication -- - --
|I
(
DELETE
CANCEL
UPDATE
DELETE
--
-
-
C.1if-1,. 8tat. UnLJ
o-itr 9-<ranto I 600o J 9t.t
--
I9
-
- -
Crmroo.A
9CCu
9u911916) 279-u1t)
I
Figure 33. Maintain criteria-category
To enter a criterion, use the Enter Criterion link in the vertical navigation menu. This
form walks the user through the process on adding a criterion. Every criterion is
associated with a specific criteria-category. First select a category by using the dropdown menu. Second use the step two drop-down menu to select the rating type. Is this
criterion scored as a team or individually? Select the appropriate rating type. Next the
I
39
user types in the criterion name as well as the descriptions for each score value. The
descriptions for each criterion area will assist the evaluator in deciding how to score the
specific criterion. An example of the enter criterion form is shown in Figure 34.
o
fe.
Ldit
Story
Er4k
Ied.
&ccesrlby
b*d
SACRAMENTO STATE
I
-
g0
Lteadershipbeins here..
is.ion I Goal. I Objetives
Ot.
1g
a
Performance Criten
Home
Computer Science Program
Public
Enter Criterion Information
Data Entry
View Rubric Form
View CriteriaCategory
View Criteria
Start Rubric Form
i
Logoot Dat. Entry
I E-aluation I Login
Step 1: Select the category with which to associate the criterion
Select criteria-category I APPEARANCE
Step 2: Criterion Rating Type
Update Rubric Form
Maintain Criteria-
Select criteria rating typeF| teeam
Categories
Enter Criterion
Step 3: Criterion Name
Update Criterion
i
The criterion name is used to describe the single row of criteria
Enter criterion name l _
_
_
Step 4: Criterion Descriptions
Enter description for exceeds criteria |
-
Enter description for meets criteria
Enter description for progressing to criteria
|
_
Enter description for below criteria---l
.SUBMfl
C.lilonl. Stot. Unlor.slty S-m.ot.
F|RESE7 |
TCUEL|
I 6000 J Staint I S eo..nte. CA 958191 (916) 276-6011
j
Figure 34. Enter criterion
To update a criterion, use the Update Criterion link from the vertical navigation bar.
The first step is to select a criterion-category. Once the category is selected, a list of all
associated criteria is displayed, as shown in Figure 35 . To the right of each criterion is
the option to update or delete. The delete button deletes the given criterion once the user
confirms the deletion request. The update button brings the user to the "Update
Criterion Information" page.
Id
40
I
fe
Edt Dtw Heston, Solameft
Tmk Acsessblitvyfb
0SACRAMENTO
in
eadership b~egins here.
STATE
I
--si~ I
-I.l
I
Home
Public
Entry
View Rubric Form
View CriteriaCategory
View Criteria
Start Rubric Form
Update Rubric Form
Maintain CriteriaCategories
Enter Criterion
Update Criterion
-tomeI Pefr
.. .iesI -
I
~~~~~go
-h
-~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
..at'
ntr-v
Loo.in I Iozu.J.. I evlainI
vnecite-i I ..........
Computer Science Program
Update Criterion
Data
Select criteria-category IAPPEARANCE
Select the chetkbox to select all the categories r
|SUBMIT |
C
Name
Exceeds Criteria
Appropriate use of
vocabulary.
Accurate use of
techinical terms
Consistently follows
rules of standard
English.
{C.lifowi. Sra. unlv~Isv
LANGUAGE
Mests Criteria
Generallyacceptable
use of vocabulary
and technical terms
and phrases.
Generally follows
rules for standard
English.
BST
ACEL|
&VOCABULARY
Progressing to Criteriao Below ExpectatIons
Vocabulary is limited.
Poor vocabulary and
individual
use of technical terms poor or inappropriate
and phrases are less
use of technical terms
and phrases.
thian desirable,
Does not follow rules of
Generally does not
follow rules of standard standard English.
individual
English.
DELETE |
DELETE
rv. n.veetol|6000 J S".t I S..w.nto., CA 9sS19 1 (916) 270-6011
Figure 35. Update criterion - select criteria-category
The Update Criterion Information page provides step-by-step instructions for updating a
criterion, as shown in Figure 36. All the fields are preloaded with the original criterion
information. The user then decides what information needs to be modified. The criteriacategory is selected from the drop-down menu as is the rating type. The criterion name
and descriptions are typed in by the user. When the modifications are complete, the user
selects the submit button. The reset button reloads the original page requesting the
criteria-category. The cancel button reloads the current page resetting all the fields to
the original information.
41
;
Etat
yew
Leary
sariss
toois &essrlby
g~ SAC
RAMlE NTO
Leodership begins here.
-_ -I -___
U*
___
I
-
-
-
-
___
~___~_ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~
_
STATE
-h
_]
go
4
Mission I Golas I Objti-ves I Outcomes I Perf.ennene Criteria I Assessmen.
t Pt.. I Eveiluation I Loein I Loorut Data Entry
Home
Public
Data Entry
View Rubric Form
View CriteriaCategory
View Criteria
Start Rubric Fom,
Update Rubric Form
Maintain CriteriaCategories
Enter Criterion
Update Criterion
Computer Science Program
Update Criterion Information
Step 1: Select the category with which to associate the criterion
Select criteria-category I LANGUAGE a VOCABULAPRY -
Step 2: Criterion Rating Type
Select criteria rating type indrdual :i
Step 3: Criterion Name
The criterion name is used to describe the single now of critena
Enter criteron name
Step 4: Criterion Descriptions
Enter description for exceeds criteria
Appropratelese of vocabulary.
Accurate use of technicel terms
Enter description for meets criteria |Gen eoly acceptable use ofvocabulery end technical terms end phrases
Enter description for progressing to criteria Ivocabulary is lrimted. Use of technical terms end phrases ore less then desirable.
Enter description for below criteria
or vocabulary nodpoor or oppropriate use oftechnical terms and phtrses
F-s6BMIT j
c.itemwi
(
SetrtUni,.r isn.5.r,.,,.,,0o I 6
RESET
A
CANCEL
I
J St,..t1 S.vmnto CA9591o 1 (916) 279.6011
-
Figure 36. Update criterion information
2.3.4 Evaluation
Under the evaluation heading, the initial screen is the same as the Prepare Evaluation
Form for Print link in the vertical navigation menu. This form assists the data entry
user to prepare an evaluation form for printing. The evaluation forrn is what evaluators
use to score a specific rubric form. The first step is to select the number of students per
group from the drop-down menu. The second step is to use the drop-down menu to
select the course in which this form will be used. The third step is to select the
appropriate rubric form. The last step is to select the semester and year in which this
),~
42
evaluation is taking place. Once these items are selected, the user clicks on the submit
button. An example of this form is shown in Figure 37.
RI M-
I
QRM I
Eie
eit
YVew Hory
A
Woia
lods
Accessbft
&*
SACRAMENTO STATE
search
g
go
Leadership begins here.
Mission I Goals I Objectives I Outcomes I Performance Criteria I Assessment Plan I Evaluation I Login I Logout Data Entry
Home
Computer Science Program
Public
Preparation for a rubric evaluation sheet
Date Entry
Enter Course
Information
Step 1: Enter the number of students per group
Update Course
Information
Please enter the number of students per group IS'±J
Enter Team
Information
Step 2: Select the course for the assessment
Update Team
Information
Select the course the team attends |190:SeniorRoreqPrt
Prepare Evaluation
Form for Print
Step 3: Select the rubric form for the assessment
Enter Score
Information
Select rubric [OradCommunication
I
l
iJ
Step 4: Select the semester and year for the assessment
Select the semester and year ELa _ I2008i.ni
|SUBMIT | RESET
IjCANCEL|
California State Universlty, Sacramento 1 6000 . Street I Sacramento, CA 95819 1 (916) 278-6011
j
Figure 37. Prepare evaluation sheet for print
After the form is submitted, an evaluation form is generated and displayed as shown in
Figure 38. The number of students per group is used when displaying the number of
lines for the student names in the header and the number of columns for criteria that are
rated individually. The course, semester, and year are already filled in so that the
evaluator does not need to be concerned with those fields. There is a link in the upper
left hand corner that brings up printer options for printing.
43
I
.p
t.
org
1.b
_ole.
,bit 5*
.veo
Pnrnt This Paae
COMPUTER SCIENCE
ORAL COMMUNICATION RUBRIC
Course: Comouter Science I90 Senior Prolect Part I
Instructor
Team Name:
Student Names:
I
_
(b)
Date:
r1Faculy
Evaluator:
(a)_
FALL 2008
(c)
r
Instructor
(d)
Computer Science
1 Student
r
1l Alumnl
(f
(e)
)
4- Exceeds Criteria
3
Organizes content lotically and
-Meets
crieria
I~Log
loially &seg..entially.
Main points are clerly identified
n
jpresented.
scnlso.Sosaiiy
tfx~csoummcuarinoze
to
Sh~ws abilitV
tItrodction &conclusion are not
cerypaetd
t
om
r
atiaton.
follows rules for
English
L __
I Generally doesnot
standard English.
_
followrules of
Neat, casua business attire I Neatcasualattre
F
__
_
individual Ratings
]
Fi jFir
I -Below Expectations_
r r-
Poor
vocabulary
pooror trms
inappropriate
useand
of tochnical
andphrases.
D|Ooes
not follow
[
[
nules
of standard
,|I
APPEARANCE
Nsat, professional businessattire
_
-conclusion/summaryare missing
atGerallyacceptable
use of
of i|Vocabulary
is limited.
Us5of are
vocabulary
and technical
technical terms
andphrases
terms and phrases.
lessthan desirable,
JGenerally
.standard
o
viec
~
Consistently follows rulesof
standard English.
evidenced
Introduction and/cr
of sau~mman~riszeantion.
S
,wd
LANGUAGE
a VOCABULARY
4 - Exceas
2|C~ele~
3 Mees c~eeo
2| 2 -Progressing eO C
Apprite use
useoftecicaltrr
1 vvo.f oaulry,
Accuronate
Ile
Team as a Whole
IMany transitions are not logical IMoot transititns are abruptSr
andsmooth. ___
_
missng.
Includes introduction, body,
a
Some organization is attamptetad,
1_- Below Epedttons
eerlly
|Main points a not
adequateloitsarymssng
Mi ..
r o
logicaltand smooth,
aecarydelineated, Provides
to Crltdeae
erogrssing
but isgenerally
lacking.
Tranitins
re ogial nd smooth. TransItonsare generally
Introduction, body, b conclusion
Ratings
2t-
Gienrally organizes content
sequentially.
cisar summary or~fprojectvides a
-
Oral CommunicatIon
ORGANIZATION
andconcisely presntd.
Industry
Attire S,appearance too inf
_J~~inapproprrate.1
or
[
I
II
Ji
i[
Individual Ratings
1
I7[F
lF
''
Figure 38. Evaluation form for print
In order to prepare for the evaluation forms, data entry users need to enter and maintain
course information. To enter a new course, select the Enter Course Information link.
This displays a form in which the user enters the department, course number, course
title, and course description. When the information is entered, the user clicks the submit
button. The cancel and reset buttons reset the form. To assist the user, a table listing the
existing courses is displayed. An example of this form is shown in Figure 39.
44
ELie S
I
- ytew__lH{ory- ____
- I- _'__ - ccess'
___ - y_ eip__ - I .1z0sars tools
A
. -
-
I
- _I- __ ___0
----
1
__- __ -
I
I1
SACRAMENTO
STATE
Leadership begins here.
..
go
Mission I Goals I Objectives I Outcomes I Performance Criteria I Assessment Plan I Evaluation I Login I Logout Data Entry
Home
Computer Science Program
Public
Data Entry
Enter Course
Information
Update Course
Information
Enter Team
Information
Update Team
Information
Prepare Evaluation
Form for Print
Enter Score
Enter Course Information
Enter course department | omputer Spence.
Enter the course number
7_7
i
Enter the course title
i
I,
f
Information
Enter the course description
:SUBMITf| IRESET-
ENCEL
I
Ji
1:
List of Courses
ijD-p
prtment
Course Number|_
|Com9!!2puter
Science|1
[Thi
QComputer Siencei10
I3JICom
p1ter
F_]Cokmputer Science-fi
o
Title
IFDescription J
computer Software Engineering_
Il
|=Senior Project: Part I
lSenior Project: Part
|Scencei
Advanced Computer Organizatiop}n
_
|1
_
_
1'_41
ii
=
Figure 39. Enter course
In the event that the course information needs to be modified or deleted, use the Update
Course Information link. The first page requests that a department be selected from the
drop-down menu as shown in Figure 40. If the user wants to view all existing courses,
then select the checkbox just above the submit button.
45
6:X
:ge
Ldt Ym_
Hi.y
e-iS
jols
Accesselty
ffep
_SACRAMENTO STATE
Leadership begins here.
Mission I Goals I Objectives I Outcomes I Performance Criteria I Assessment Plan I Evaluation I Login I Logout Data Entry
Computer Science Program
Update Course Information
Home
Public
Data Entry
Enter Course
Information
Update Course
Information
Enter Team
Select a department
Select a department
e
a department_____
____ _
Select the checkbox to select all the departments 171
ISUBMrr |IESET
Informaton
CANCEL |
Update Team
Figure 40. Update course - select department
The next page displays all the courses available for the selected department, as shown in
Figure 41. To the right of each course listing is an update and delete button. The delete
button deletes the course once the user confirms the deletion request. The update button
displays a page for updating the specified course.
!_
Ile
__
Udit tew
I__ _
_R
T-
Xr
HlDtory Eeoekarks loeds Accessdibty11*
I
-g
^
X
ØSACR~~AMENTO
STATE
Leadership begins here.
.. hg
Mission I Goals I Objectives I Outcomes I Performance Criteria I Assessment Plan I Evaluation I Login I Logout Data Entry
Computer Science Program
Home
Public
Update Course Information
Data Entry
Enter Course
Information
Update Course
Information
Enter Team
Information
Update Team
Information
Prepare Evaluation
Form for Print
Enter Score
Information
List of Courses for Comnuter Science
i9jl Department
lCourse Number
l[Computer Science| 131
Compute
_
_
4 Computer Science 142
I
_
Description
E
Computer Software Engineein
Computer Science 190
gComputer Scince191
iF
Title
FSenior Project Part I
n
UPAT
__
S____
enir
Project:Partl Ii
__
1vanced Computer Organization
*--
, id,
---
__PrjetPrtI
DELETE
"
-
aI
Figure 41. Update course - select course
Once a course to be updated is selected, the Update Course Information form is
displayed. The existing course information is displayed in editable text boxes except for
46
the department which is a drop-down menu, as shown in Figure 42. To update the
course information, the user modifies the appropriate fields and clicks on the submit
button. The cancel button reloads the original information. The reset button brings the
user back to the original update course information page.
tie
bete
eools&coessibiy
1-4tory Bfeskrarks
Edit Y-w
STATE
OSACRAMENTO
beginshere.
.
Leawdership
go
marsh
Mission I Goals I Objectives I Outcomes I Performance Criteria I Assessment Plan I Evaluation I Login | Logout Data Entry
Computer Science Program
Home
Update Course Information
t
Public
iData Entryr
Enter Course
Information
Update Course
Information
Enter course department I Computer Science
Enter Team
Enter the course title JCoRputer Softore Engineering_
information
Enter the course number |l31
|
J
Update Team
Information
Prepare Evaluation
Form for Print
Enter Score
information
Enter the course description
------
.SUBMIT
-
Caltfen~~~ta
StateUniW-Ity, S---wnt. 16000
|ESET
CANCEL
StreetI S...anten, CA 95819 1 (916) 2~61
Figure 42. Update course information
When it comes time to enter the completed evaluation forms, the data entry user needs to
first enter the group names. This is achieved by using the Enter Team Information
link in the vertical navigation menu. To enter a team name, the user selects from the
drop-down menu the course in which the team is enrolled, types in the team name, and
then clicks the submit button. On the bottom half of the page, a list of current teams is
displayed so that the user can see what teams have already been entered. An example of
this form is shown in Figure 43.
47
Bie
B%y
Sw
Edt
a
5om-wklra
1
A"MIJAY
- I--
A
I
H*
0 SACRAMENTO STATE
eash
9
Leadership begins here.
Mission I Goals I Objectives I Outcomes I Performance Criteria I Assessment Plan I Evaluation I Login I Logout Data Entry
Home
Computer Science Program
Public
Enter Team Information
Data Entry
Enter Course
Information
Step 1: Select course
Update Course
Information
Select the course the team attends 100l.Beginn9_gCompuler Sciengc
Enter Team
Informatron
Step 2: Enter team name
Update Team
Information
Enter the team name
E
|SUBMnI
Evaluation
S
:
FCANCEL |
Form for Print
Enter Score
Information
Current List of
reams
List of Teams for OOl:Beainnino Computer Science
Date Added
I
Team Name
21, 2008
|Sep 24, 2008
Let's Go
Here we go
50o
List of Teams for 190:Senior Proiect: Part I
Team Name
IAu
ProtoType
.1
C
-
7
California State Uninersity, Sacramento
|
2
10, 2008
Dote Added
60001 Street I Sawramento, CA 95819 1 (916) 278-6011
Figure 43. Enter team
If the team information needs to be updated, then the user clicks on the Update Team
Information link. The user selects a specific course or the checkbox which selects all
the courses and then clicks the submit button. Once the course is selected, a list of teams
from that course is listed, as shown in Figure 44. The team name can be modified and
then saved by clicking the update button. The delete button deletes the specified team
once the user confirms the deletion request.
48
I
EdL Tw
BEe
Hgoiry
Edlmarksl- tods
&ccessiblty
ifelp,
STATE
ISACRAMENTO
I
|
..
-d-h.h
I
s-h
h-
Mission I Goals I Objectives I Outcomes I Performn.e cntena I Assessment Plan I Evaluation I Login I Logout Data Entry
Home
Computer Science Program
Public
Update Team Information
Data Entry
Enter Course
Information
Update
Course
Information
Enter Team
Information
Update
Team
Information
g
=l
Step 1: Select course
Select the course the team attends jL00eginning Computer Science_ _
Select the checkbox to select all the courses C
SUBMrr
F!RESET
CACEL
List of Teams for 19O:Senior Proiect: Part I
Team Name
Prepare
Evaluation
Form for
Print
Date Added
In *.i
ug 10, 2008
PiotoTypee
Enter Score
Information
C.Jtfoni Stst.UN-.Ry. 500..nwnt160i6000
i 55sSt tntsCnsent1.
CA 95819 1
(916) 276-6011
Figure 44. Update team
With the team information prepared, then user is ready to enter the evaluation scores.
This is done by selecting the Enter Score Information link in the vertical navigation
menu. The process starts with the Prepare Score Sheet form, as shown in Figure 45.
The user follows the six steps using the information found on an evaluation form. The
required information is the number of students per group, the course being assessed, the
rubric form being used, the semester and year of the assessment, the evaluator type, and
the date the assessment form was completed. Once each step is completed, click the
submit button.
49
.
~
.,
~~ ~
~
~
~
~
~
D x=11
.
Fie
.
I;I
0
Edit
Kew
Hitory
Laolssauks
lools
d*
Accessibility
SACRAMENTO STATE
search
Leadership begins here.
Mission I Goals I Objectives I outcomes I Performance Criteria I Assessment Plan I Evaluation I Login I Logout Data Entry
'I
Home
Public
i
II
i
I
I
Data Entry
Enter Course
Information
Update Course
Information
Enter Team
Information
Update Team
Information
Prepare Evaluation
Form for Print
Enter Score
Information
Computer Science Program
Prepare Score Form
Step 1: Enter the number of students per group
Please enter the number of students per group TIL
Step 2: Select the course for the assessment
Select the course the team attends I 190Senior Project PartI
Step 3: Select the rubric form for the assessment
Select rubric| Oral Communication
3
i
Step 4: Select the semester and year for the assessment
i
Select the semester and year [Go!7j2
FTI20781
Step 5: Select the evaluator type for the assessment
Ii
Evaluator type using the rubric | {cuityL±J
i
J
i
i
i
I
I (
Step 6: Select the date of the assessment
Assessment date using the rubric. |p
iber _ iJ
FTSUBMIT |RESET
California State University, Sacramentoe
33
E9
I CANCEL |
I 60001 JStreetI Sacramento, CA 95819 1 (916) 278-6011
Figure 45. Prepare score form
The next form is where the actual scores are entered, as shown in Figure 46. The top
portion of the form is automatically filled in with the information from the previous
form. The course name, evaluator type, semester and year, and assessment date are
preloaded. The user enters the course instructor name and selects the team name. The
bottom portion displays the selected rubric form with a drop-down menu for each score.
The user selects the score values according to the evaluation form and clicks submit.
The user can continue entering scores from multiple evaluation forms. Except for the
50
team name, the top portion remains constant so that the user can focus on the score
values. When the last page is entered, the user selects the radio button at the bottom
noting this as the last evaluation form for this set. The application then returns to the
Prepare Score Form where new evaluation form values may be entered.
,SACRAMENTO
Q,
STATE
E Z9 g
I
Leaderrhipbegisherm.o
i.s.iof I Gonl. I Objectives I Outcomes I Per-ororonceCiterid I ssess.me.tPlan I E.aisatisn I Login I Losout Dats Eotry
Home
Computer Science Program
PotblEntr
Dots Estree |j
Enter Score Form
Course
COMPUTERSCIENCE
lnformabonr|
courtee
Instrudcor
lnformatlon
Prepare
Evaluatinn
Form for
Print
Entor Scre
Irformation
Dote: Oct 19J ZD00
ijuckdery
Informas on E
Informabon
* Ent.r
Team
Ifpdate ion
FALL 2008
ORAL COMMUNICATION RUBRIC
| Course: CommutterScence 1900 Senior Prolect Part I
-
eomNeme
I.Eli
Evaluator.
--- _
'
l _
-.
r' Student
1 Alumni
ReSI=tS
Ft-in
Inar
r
rl
d1erFt
__n h__________ ___
_
_
__
_
*rt-r-nde
rdif ollr
dmrsi
Someorganization is
arrmd but is gse.ral|
_I_ ___________
_
__
_
_______tsu~s_
_
I
- Below Expeotlos-
|
Liitte edier', rf orioa ratoi
.1.___.__
___
_
Team as a Whole
__
__
_.__
__
,
.r
_r=-ralNi
fJ1'ja~rdG
lrujld!r-srr2.
l
_
rrisr,_____
___ __
Wa riEcfffibanrct _mu60
21
~œ||tab~rrcani
anyoe
F erf
rvardatlir!rbtus
ar}_i
ILN
tlffili
160CABIJIUCaartcnl
nndirJdunl
Tifrotrdduiro
re..ornln
~elatsrEiiiro
rmraltittfli~:
Er~irtu nnioi Ia
-Enir
sd
f
_l
.
hoD
,i
2!sCrtei.
-Progressing toCrteHria
soo.elr.
l` ondustry
Communictlon
1
rly
all'y organivos
nnvvaet ugmal r B
Oranzsentetloi
Organizes content lobically
cr.leriiltepaaa.
_
jrt
.m
1 instructor
ORGANIZATION
4 -Exeeds C tler
[T.
l Facunlty
ii
'
Fi
arr
re
tcn~do~enl
|fo-~rwriu'ro
ardoli bse2fjtbint lOfiardIclr~~
_
3;F_
ildtdul
l
le
l~nIiva
I|| 7rl., rtcufli r
og _. _e_ _mt
_____
| r:a
_-ik-tart
.in nim
-In itCnihorid |
I
____ m.____.
cfodt.nn
umnvi-,rrii59
3-nra:
relteohlo~
I-4~Ii~liC~lll~tol
-
ict
7
ae eisjur
Etrl
rls-h.
LSUE~
HTfE;Tol
~ ~
~neeestlrzte~~!I
~~~~-i.
jr1
|| |
-1
sauEi'Arr
LR
I
_______1
Figure 46. Enter score form
I
_____----:- - -_________
|
____
_
J4
IW
EfilbSUg
.. jl..ii
I
rT3 A~~~a~l~e.C~i
elleldool i}JiEL
ratoe -
-eall-Rllimmact-H~nE lcor
I
Fit o JI LoI I jzl~ 1 Co')I 1
i_~-o.rms
'nurr.ot
ruovc.
nlnnui~~~i-rrI
FioviOo~~~ual~~turiyfl
trunooni
alnnio
rr
__ ___.__ _
for Ssi.irbrmdonrcrian
moci
coetuurl
6 . vtretnr
E nutemrsco
g 0u reo
|tldetasd
loo r
A-dtiner E.,ith. _ ___ frcsla!ndamilicr.h
ler .amrmarbolsadX
f gh
± tdtr
.atA'
'i*l
__.__
F4-[ri
51
Chapter 3
SYSTEM DESIGN AND DEVELOPMENT
3.1.
Overview
The system design and development is the core of this project. This chapter details how
the various web pages are loaded and how the forms are processed. This is the business
layer where the PHP processing is done in the background. This is the layer that sends
and receives requests between the presentation layer and the third layer, the data layer.
The data layer is a MySQL database.
3.1.1
Template
The front end of this project is based on the University-approved Sacramento State Web
Templates. To provide the greatest amount of real estate on the page, the two-column
with navigation template is utilized. It has a green horizontal navigation menu of
required links. The white horizontal navigation menu with green lettering may be
modified as required. The beige vertical navigation menu may also be modified as
required. The two columns of the template are the vertical navigation menu and the
content body. In the example shown in Figure 47, the Program Educational Objectives
is the content body. The Sacramento State Web Templates are stated to be compliant
with the requirements of Section 508 of the federal Rehabilitation Act. As a result, as
long as the content body is compliant, the requirement of accessibility is fulfilled.
52
The body content accessibility issues are discussed as the context of each content section
is explained. However, the template does include one line of code for the body of each
page. By design, all pages in this project will start with a heading level 1 header (hl)
stating "Computer Science Program". This continues the uniform look and feel of the
application.
White
horizontal
navigation
menu/
<;.te
b
,
wdt:
rerw
o
B y
j
Green
horizontal
navigation
menu
-
11
~
aoeostre
v l~
uek
e X twi
_ __'-_
_ _ _ __'_
_
__/_
_'
_'_i_
_
__ _ _ r
E Z II°
/.search
STATE
aSACRAMENr.
Leadetrshipbeginshere.
t'
___
-
MissionI GoalsI Objectives "`utc-ese I LoginI Logout
4Home
Public
Department
Objectives
College
Objectives
University
Objectives
Ve
ra
navioation
* f-
m enu
i
L
_
Computer Science Program
Program Educational Objectives
Broad statements that describe career & professional accomplishments
DescrIption
Objective
and
1
Tobe a significant contributor in oneor moreof the aspectsassociatedwith the development, maintenance,
supportof realworldcomputingsystems.
2
To be an effective andcontributing memberof a project team.
opportunities, and/or pursuepostgraduate studies.
development
3
To be continually engagedin the pursuitof professional
rolein their chosencareerandprofession.
4
To assume
a leadership
andin reviewingandrevisingthose prepared
competencein producinghighquality written documents,
To demonstrate
by others.
anddeliveringtechnical andnon-technical presentations of highquality to a
6
To demonstrate
competencein developing
varety of audiences.
activities,
7
Toabideby the ethical standards of the professionandunderstandthe socialimplicationsof their professional
im
staInes, =
m o 60
A eetO emt c,
l( v-1 e -
--
,
-_
Figure 47. Template
3.1.2 Security
It is important to ensure that a web application is secure from online users as well as
offline users. For the purposes of this project, the application is secure from online users
by utilizing a login feature for sensitive locations. Each page verifies the user status
before allowing any sensitive information to load. In the case of offline users, the file
53
permissions are set so that only the file owner has full read, write, and execute
permission. The group ID is set to httpd, the web daemon, and it is only allowed to read
and execute files and folders with the only exception being the upload folder for
attachments. Those that are not the user nor are part of the group have no permissions.
This prevents people from gaining access to the files and its information through a
command line interface.
3.1.3
Generalfunctions
For the ease of maintainability, writing code modularly is very important. In this
project, there are a number of shared files with shared functionality. The db.inc file
contains the functions that report MySQL errors, connects to and disconnects from the
database, etc. Other utility functions, such as querying the database, generating form
components, etc., are included in the utility.inc.php file. These are general functions that
are used multiple times across the application. Constant definitions and a list of session
variables are part of the define.inc.php file. These files create a single point of reference
for any given feature. If a function or feature needs to be modified, then it is updated in
a single location and utilized throughout the application.
3.1.4
Generalfile layout
In order to have the web application visible to all users, template files are uploaded to
the server with correct permissions set for all files and folders. For the Sacramento State
Web Template, this includes the images folder and all the files within, the includes
folder containing the includes.inc and template.inc.php file, and the main folder
54
containing index.php and webstyles.css. The includes folder is the location for shared
functions and where each file name ends in .inc.php. The .inc indicates that it is an
include file. The .php assists the web developer that uses web tools, such as
Dreamweaver, for they color code in .php files but does not color in files ending in .inc.
The includes.inc file contains a listing of all the other include files. This allows for the
webpages to reference the single file, includes.inc, and not list the collection of include
files that it may use. For maintenance purposes, this reduces the possibilities for errors
and limits the number of files that need to be modified when a new includes file is
added. Each section of the application has its own includes file, and so the template uses
the template.inc.php file. This file breaks down the header, footer, and body portions
into functions that other pages can reference. The index.php file is the default webpage
that loads when the user goes to the top-level Uniform Resource Locator (URL) for the
application and does not specify a specific file. For this project, the file redirects the
user to the Department mission page. The webstyles.css is a cascading style sheet file
which defines the look and feel of the webpages. This allows for style tags to be
uniformly defined in a single location which improves consistency and makes
maintenance of the web application more manageable.
3.2. Mission
In the mission section, each of the Department, College, and University mission vertical
navigation links goes to a separate page. The file naming convention is
mission_<topic>.php (e.g., mission department.php), and the mission include file
containing mission specific functions is called mission.inc.php. Each of the mission
55
pages uses the general DisplayMissionNavigation function to generate the vertical
navigation menu and their respective function Display<topic>Mission (e.g.,
DisplayDepartmentMission) to display the appropriate content body. Each of the static
mission statements start with a heading level 2 header (h2) and may continue with a
heading level 3 header (h3). It is important that all heading levels be used in order so
that accessibility tools can interpret the page correctly.
3.3.
Goals
In the goals section, each of the Department, College, and University mission vertical
navigation links goes to a separate page. The file naming convention is
goals <topic>.php (e.g., goals department.php), and the goals include file containing
goal specific functions is called goals.inc.php. Each of the goals pages uses the general
DisplayGoalsNavigation function to generate the vertical navigation menu and their
respective function Display<topic>Goals (e.g., DisplayDepartmentGoals) to display the
appropriate content body. Each of the static goals statements start with a heading level 2
header (h2) and may continue with a heading level 3 header (h3). It is important that all
heading levels be used in order so that accessibility tools can interpret the page correctly.
3.4.
Objectives
In the objectives section, each of the Department, College, and University objectives
vertical navigation links goes to a separate page. The file naming convention is
objective <topic>.php (e.g. objective department.php). The objectives include file
56
containing objective specific functions is called objective.inc.php. Each of the
objectives pages uses the general DisplayObjectiveNavigation function to generate the
vertical navigation menu and their respective function Display<topic>Objectives (e.g.
DisplayDepartmentGoals) to display the appropriate content body. Each of the
objectives pages start with a heading level 2 header (h2) and may continue with a
heading level 3 header (h3). It is important that all heading levels be used in order so
that accessibility tools can interpret the page correctly. The College and University
objectives are static hard coded objectives. The Department objectives table is generated
by a MySQL query to the objective table. The table uses table header <th> tags instead
of bold tags, which visually look the same but accessibility tools interpret the table
header tags and provides more detailed information to the user.
The Maintain Objectives is broken down into two sections, Add New Objective and
Update Objective. The Add New Objective form consists of a text box preloaded with
the next objective number which is automatically generated with a query to the objective
database table. This number is tested when the form is submitted to ensure that the
information entered is of the correct numerical format. The description is an editable
text field. It is not tested for it is only used to display the contents in various tables and
does not create a security risk. If an error occurs with the objective number, then it is
caught when the form is processed in the process objective.php file. At that point, error
session variables are set and the form is reloaded with the modified fields and an
appropriate error message is displayed. If there are no errors, then the form is processed
57
and the information is saved in the objective database table. The Update Objective
section is a series of forms. Each form contains the information of a single objective.
The objective number is tested when the update button is selected. This ensures that the
information entered is of the correct numerical format. The description is an editable
text field. It is not tested for it is only used to display the contents in various tables and
does not create a security risk. If an error occurs with the objective number, then it is
caught when the form is processed in the processobjective.php file. At that point, error
session variables are set and the form is reloaded with the modified fields and an
appropriate error messages is displayed. If there are no errors, then the form is
processed and the information is saved in the objective database table. If the delete
button is selected, then the information for the specific objective is saved in session
variables along with the session variable, DELETECHECK, which is set to true. At
this point, a verify deletion form loads requiring that the user verify the information to
be deleted. If the deletion is cancelled, then the session variables are cleared. If the
deletion is approved, then the session variables are used to complete the deletion process
and are then cleared. To assist the data entry user, the update button is colored green,
the delete button is colored red, and the cancel button is colored yellow when the mouse
hovers over a given button.
The View Attachments selection starts with a form that requires the user to select an
objective from the drop-down menu or the checkbox which selects all of the objectives.
The drop-down menu is generated by querying the objective table and displaying the
58
results. When an objective or checkbox is selected with the submit button, the form is
processed in the processattachment.php file. If the checkbox is selected, then a list of
objectives is retrieved from the objectiveattachmentmap table. The list is looped
through and a table of attachments is generated for each objective. The first row in the
table is the objective description. The following rows display a link to the attachment
file, the date added, and the last date modified. The rows of attachments are generated
by a MySQL query that cross references the attachment IDs associated with the specific
objective in the objective attachment map table with the attachment ID from the
attachment table. From there the specific attachment details are retrieved. If a single
objective is selected, then no loop is required and only a single table is displayed. The
reset and cancel buttons reset the View Attachments page.
The Enter Attachments section is a form with two parts. The first part is a file
component that allows the user to browse to a specific file to upload. This file must
follow the requirements stated below the browse button. The second part is a series of
checkboxes, which are generated with a query that requests all the information from the
objective database table. Each checkbox is associated with a single objective and the
last checkbox selects all of the objectives. When the user selects the submit button, the
form in processed in the process_attachment.php file. First the attachment file is
uploaded to the server. If there are any errors, then they are displayed to the user. If
there are no errors in the upload, then the file information is saved in the attachment
database table. Also, the objective selections are saved in the objective_attachmentmap
59
database table. There is an entry in the mapping table between every objective and the
new attachment. Each entry contains a flag field called active to indicate if the specific
objective is associated with the specific attachment. If the checkbox noting all of the
objectives is selected, then the active flag will be entered as true for every entry
associated with the new attachment file.
The Maintain Attachments is a multiple step process to update an attachment. The first
form requires the user to select an attachment from the drop-down menu. The dropdown menu is generated by querying the attachment table and displaying the results.
The selection can be updated or deleted. To assist the user, when the mouse hovers over
a button, the update turns green and the delete turns red. If the delete button is selected,
then the specific attachment information is saved in session variables along with the
session variable, DELETECHECK, which is set to true. At this point, a verify deletion
form loads requiring that the user verify the attachment to be deleted. If the deletion is
cancelled, then the session variables are cleared and the maintain attachment page is
reloaded. If the deletion is approved, then the session variables are used to complete the
deletion process and are then cleared. If the update button is selected, then another form
loads in which the file information is displayed at the top with a link to the file as well as
the date added and the data last modified. Below is a series of checkboxes, which are
generated with a query that requests all the information from the objective database
table. Each checkbox is associated with a single objective but the last checkbox selects
of all the objectives. These checkboxes are preloaded with the information from the
60
objective_attachment map table indicating whether a given objective is currently
associated with the selected attachment file. At this point, the user can modify the
settings as appropriate. When the update button is selected, the form is processed and
the information is updated in the objectiveattachmentmap database table. If cancel is
selected, then the user is returned to the original maintain attachments page.
3.5.
Outcomes
In the outcomes section, the Department Outcomes, College Outcomes, and the
University Learning Goals vertical navigation links goes to a separate page. The file
naming convention is outcome_<topic>.php (e.g., outcome department.php), and the
outcomes include file containing outcome specific functions is called outcome.inc.php.
Each of the outcomes pages uses the general DisplayOutcomeNavigation function to
generate the vertical navigation menu. The Department outcomes table is generated by a
MySQL query to the outcomes table. The table uses table header <th> tags instead of
bold tags, which visually look the same but accessibility tools interpret the table header
tags and provides more detailed information to the user. The College outcomes and the
University learning goals are static hard-coded outcomes. Each of the outcomes pages
start with a heading level 2 header (h2). It is important that all heading levels be used in
order so that accessibility tools can interpret the page correctly.
The View Objective-Outcome Matrix page is generated in stages. The table starts with
the objective and outcome headers which have anchor tags that link to the associated
tables below the main matrix table. Next the database is queried for all of the
61
information from the outcome table. This information is used to generate the row of
outcome letters which display the outcome description when the user's mouse hovers
over a given letter. Before the matrix rows are generated, all the objective information is
retrieved from the database. The rows are generated with a while loop cycling through
each objective. For the matrix columns, the objectiveoutcomemap is queried to
retrieve all the mapping information between the specific objective and the outcomes.
An inner for loop cycles through each mapping result and mark which outcomes are
associated with the given objective. Once the matrix table is complete, more links to the
objective and outcome tables are added followed by the actual objective and outcome
tables. The user can use these tables to cross-reference to the objective numbers and the
outcome letters.
The View Objective-Outcome Table selection first retrieves all the objective
information as well as the number of outcomes. Next a while loop cycles through each
objective. The objective information is added to the table using a header tag (<th>).
The outcome information that follows is generated from a MySQL query that retrieves
the mapping and associated outcome information. This query utilizes the foreign keys
between the objective, outcome, and objective outcomemap tables to obtain the
pertinent information effectively. An inner for loop displays the retrieved outcome
information.
62
The Enter Outcome selection is a form to add a new outcome followed by the student
learning outcome tables below it for reference. The form consists of a text box
preloaded with the next outcome number which is automatically generated with a query
to the outcome database table. This number is tested when the form is submitted to
ensure that the information entered is of the correct numerical formnat. The drop-down
menu of outcome sources is automatically generated by retrieving the enumerated field
options from the database. This prevents data entry errors for the outcome source field.
The description text area is an editable text field. It is not tested for it is only used to
display the contents in various tables and does not create a security risk. If an error
occurs with the outcome number, then it is caught when the form is processed in the
processoutcome.php file. At that point, error session variables are set and the form is
reloaded with the modified information and an appropriate error message. If there are no
errors, then the form is processed and the information is saved in the outcome database
table. To assist the data entry user, the outcome information is displayed in separate
tables grouped by the outcome source. In addition, each outcome number is displayed as
both a number and a letter so that the user can see how to two are related.
The Update Outcome selection is a series of forms. Each form contains the information
of a single outcome. The outcome number is tested when the update button is selected.
This ensures that the information entered is of the correct numerical format. The dropdown menu of outcome sources is automatically generated by retrieving the enumerated
field options from the database. This prevents data entry errors for the outcome source
63
field. The description text area is an editable text field. It is not tested for it is only used
to display the contents in various tables and does not create a security risk. If an error
occurs with the outcome number, then it is caught when the form is processed in the
processoutcome.php file. At that point, error session variables are set and the form is
reloaded with the modified information and an appropriate error message. If there are no
errors, then the form is processed and the information is saved in the outcome database
table. If the delete button is selected, then the information for the specific outcome is
saved in session variables along with the session variable, DELETECHECK, which is
set to true. At this point, a verify deletion form loads requiring that the user verify the
information to be deleted. If the deletion is cancelled, then the session variables are
cleared. If the deletion is approved, then the session variables are used to complete the
deletion process and are then cleared. To assist the data entry user, the update button is
colored green, the delete button is colored red, and the cancel button is colored yellow
when the mouse hovers over a given button.
The Update Objective-Outcome Matrix is a sequence of forms. The first form
requires the user to select an objective from the drop-down menu. The drop-down menu
is generated by querying the objective table and displaying the results. The cancel and
reset option reload the page. When the user selects submit, the form is processed in the
processoutcome.php file and the selected objective is saved in a session variable. The
second form displays a table with the selected objective information followed by a series
of checkboxes, which are generated with a query requesting all the information from the
64
outcome database table. Each checkbox is associated with a single outcome. These
checkboxes are preloaded with the information from the objective outcomemap table
which indicates whether a given outcome is currently associated with the selected
objective. At this point, the user can modify the settings as appropriate. When the
submit button is selected, then the form is processed and the information is updated in
the objectiveoutcomemap database table. If cancel is selected, then the original
information is reloaded to the current page. The reset option returns the user to the
original modify objective-outcome matrix page.
3.6.
Performance Criteria
The View Rubric Form selection begins with a form that requires the user to select a
rubric form from the drop-down menu. The drop-down menu is generated by querying
the rubricform table and displaying the results. When the rubric form is selected with
the submit button, the form is processed in the processcriteria.php file and the selected
rubric form ID is saved in a session variable. With the RUBRICFORM session
variable set, the rubric form is displayed for the user. The rubric form is generated
through a number of steps. First, the specific rubric form information is retrieved from
the database. Second, from the retrieved rubricform table information, the outcomeid
is used to retrieve the associated outcome information. These two pieces enables the
first row in the table to be generated. The program name is in one column width
followed by the rubric form title, which spans the rest of the table width. The categories
and criteria are next. The categories are retrieved from the database by selecting all the
categories whose rubric-form-id foreign key match the specific rubric form. The
65
collection of categories is process through a while loop so that the criteria can be
grouped with each specific category. The criteria are retrieved from the database by
selecting all the criteria whose rubric_categoryid foreign key match the specific
category. From there, a table header row is added which displays the category name
followed by a rating cell. A second header row is added which define the four scoring
possibilities followed by a cell contain more rating information if needed. The category
name is four columns wide so that it visually includes the various scoring details.
Following the header rows, the criteria information for the specific category is displayed.
An inner loop is used so that each criterion displays its specific information on a separate
row.
The View Criteria-Category selection starts with a form that requires the user to select
a rubric form from the drop-down menu or the checkbox indicating all of the rubric
forms. The drop-down menu is generated by querying the rubricform table and
displaying the results. When the rubric form or checkbox is selected with the submit
button, the form is processed in the process_criteria.php file. If the checkbox is selected,
then all criteria-category information is retrieved and grouped by the rubric form,
otherwise the rubric form ID is saved from the form and matched against the
rubricformid foreign key field in the rubriccriteriacategory table retrieving all
criteria-categories that are associated with the selected rubric form. Once the
information is retrieved, it is displayed in one or more rubric form tables with each row
66
containing the details of a specific criteria-category. The reset and cancel buttons reset
the View Criteria-Category page.
The View Criteria selection starts with a form that requires the user to select a criteriacategory from the drop-down menu or the checkbox indicating all the categories. The
drop-down menu is generated by querying the rubriccriteria category table and
displaying the results. When the category or checkbox is selected with the submit
button, the form is processed in the process criteria.php file. If the checkbox is selected,
then all criteria information is retrieved and grouped by the criteria-category, otherwise
the category ID is saved from the form and matched against the rubric category id
foreign key field in the rubriccriteria table retrieving all the criteria that are associated
with the selected category. Once the information retrieved, it is displayed in one or more
criteria-category tables with each row containing the details of a specific criterion. The
reset and cancel buttons reset the View Criteria page.
The Start Rubric Form selection creates a new rubric form and displays a table listing
the current rubric form titles for reference. Step one of the form is generated by
retrieving all the information from the outcome database table and displaying the list of
outcomes with radio button options. Since a rubric form is associated with one and only
one outcome, the radio buttons function well to enforce this rule. The outcome selection
is tested when the form is submitted to ensure that an outcome has been selected. The
title is an editable text field. It is not tested for it is only used to display the contents in
67
various tables and does not create a security risk. If an error occurs with the outcome
selection, then it is caught when the form is processed in the process_criteria.php file.
At that point, error session variables are set and the form is reloaded with the saved
information and an appropriate error message. If there are no errors, then the form is
processed and the information is saved in the rubricform database table.
The Update Rubric Form selection is a multiple step process. The first form consists of
a table with each row being a separate form with update and delete buttons to the right of
the rubric form title. If the delete button is selected, then the information for the specific
rubric form is saved in session variables along with the session variable,
DELETECHECK, which is set to true. At this point, a verify deletion form loads
requiring that the user verify the rubric form to be deleted. If the deletion is cancelled,
then the session variables are cleared and the table listing the rubric forms is reloaded. If
the deletion is approved, then the session variables are used to complete the deletion
process and are then cleared. If the update button is selected, then a new form loads.
This form starts with a table containing the rubric form ID and an editable text field with
the current title preloaded. The table is followed by a list of outcomes with radio button
options. The current outcome is preselected. Since a rubric form is associated with one
and only one outcome, the radio buttons enforce this rule. When the submit button is
selected, the form is processed in the process criteria.php file and the information from
the form is updated in the rubric-form table. The cancel button reloads the page with the
68
original rubric form information. The reset button returns the user to the initial update
rubric form page.
The Maintain Criteria-Categories selection is broken down into two sections, Enter
Category Information and Update Category Information. The Enter Category
Information form consists of a rubric form drop-down menu which is populated by
querying the database for existing rubric forms. The drop-down menu prevents data
entry errors for the rubric form selection. It is critical that the rubric form entry be valid
for it is used as a foreign key to the rubricform table. The criteria-category title is an
editable text field. It is not tested for it is only used to display the contents in various
tables and does not create a security risk. If the submit button is selected, then the form
is processed in the process criteria.php file and the information is saved in the criteriacategory database table. The Update Category Information selection is a multiple step
process that updates a criteria-category. The first form requires the user to select a
rubric form from the drop-down menu or use the checkbox indicating all the rubric
forms. The drop-down menu is generated by querying the rubric-form table and
displaying the results. When the rubric form or checkbox is selected with the submit
button, the form is processed in the process_criteria.php file. If the checkbox is selected,
then all criteria-category information is retrieved, otherwise the rubric form ID is saved
from the form and matched against the rubricform_id foreign key field in the
rubriccriteriacategory table to retrieve the criteria-categories that are associated with
the selected rubric form. With the information retrieved, it is displayed in a table with
69
each row being a separate form with update, delete, and cancel buttons to the right of the
category. The rubric title is static, but the category is a preloaded text box that can be
modified as appropriate. If the update button is selected, then the form is processed and
the information is updated in the rubriccriteria category table. If the delete button is
selected, then the information for the specific criteria-category is saved in session
variables along with the session variable, DELETECHECK, which is set to true. At
this point, a verify deletion form loads requiring that the user verify the category to be
deleted. If the deletion is cancelled, then the table of category forms reloads with the
original information. If the deletion is approved, then the session variables are used to
complete the deletion process and are then cleared. If the cancel button is selected, then
the table of category forms reloads with the original information. To assist the data
entry user, the update button is colored green, the delete button is colored red, and the
cancel button is colored yellow when the mouse hovers over the given selection.
The Enter Criterion selection is a form which consists of four steps. Step one and step
two use drop-down menus. The criteria-category drop-down menu is populated by
querying the database for existing categories. The criterion rating type field is generated
by retrieving the enumerated field options from the database. The drop-down menus
prevents data entry errors for the criteria-category and the criterion rating type fields. It
is critical that the criteria-category entry be valid for it is used a foreign key to the
criteria-category table. Step three and step four use editable text fields. These are not
tested for it is only used to display the contents in various tables and does not create a
70
security risk. When submit, reset, or cancel is selected, the page proceeds to the
process criteria.php file where it is processed. If the submit variable is set, then the
processed form saves the information in the rubric-criteria table. Otherwise, the Enter
Criterion Information page is reloaded.
The Update Criterion selection is a multi-form process. The first form requires the user
to select a criteria-category from the drop-down menu or the checkbox selecting all of
the categories. The drop-down menu is generated by querying the
rubriccriteriacategory table and displaying the results. When the category or
checkbox is selected with the submit button, the form is processed in the
process criteria.php file. If the checkbox is selected, then all criteria information is
retrieved and grouped by the criteria-category, otherwise the category ID is saved from
the form and matched against the rubriccategoryid foreign key field in the
rubric-criteria table to retrieve the criteria that are associated with the selected category.
With the information retrieved, it is displayed in a table with each row being a separate
form with update and delete buttons to the right of the criterion. If the delete button is
selected, then the information for the specific criterion is saved in session variables
along with the session variable, DELETECHECK, which is set to true. At this point, a
verify deletion form loads requiring that the user verify the criterion ID to be deleted. If
the deletion is cancelled, then the session variables are cleared and the initial update
criterion page is loaded. If the deletion is approved, then the session variables are used
to complete the deletion process and are then cleared; If the update button is selected,
71
then a form which consists of four steps is loaded. Step one and step two use drop-down
menus. The criteria-category drop-down menu is populated by querying the database for
existing categories. The criterion rating type field is generated by retrieving the
enumerated field options from the database. The drop-down menus prevent data entry
errors for the criteria-category and the criterion rating type fields. It is critical that the
criteria-category entry be valid for it is used as a foreign key to the criteria-category
table. Step three and step four use editable text fields. These are not tested for it is only
used to display the contents in various tables and does not create a security risk. When
submit, reset, or cancel is selected, the page proceeds to the process criteria.php file
where it is processed. If the submit variable is set, then the processed form updates the
information in the rubriccriteria table. If the cancel button is selected, then the current
form reloads with the original information. The reset returns the user to the original
Update Criterion page.
3.7.
Evaluation
The View Evaluation Data selection displays the overall score percentages for the oral
communications rubric form. This is achieved by starting with the rubric form. First, all
the oral communications rubric form information is retrieved. Next, the outcomeid
from the rubric form table is used to retrieve all the associated outcome information.
This information is displayed in the first row of the results table when the mouse hovers
over the rubric form title. Next, the categories are retrieved by matching the
rubric formid from the rubriccriteria category table with oral communications rubric
form ID. The collection of categories is processed through a while loop so that the
72
criteria can be grouped with each specific category. The criteria are retrieved from the
database by selecting all the criteria whose rubriccategoryid foreign key match the
specific category. From there, a table header row is displayed, which includes the
category name and labels stating the number of scores used, the percentage of scores that
are equal to 4, the percentage of scores that are equal to 3, the percentage of scores that
are equal to 2, and the percentage of scores that are equal to 1. The category name is
four columns wide so that it visually includes the various scoring details. A second
header row is added which define the four scoring. Following the header rows, the
criteria information for the specific category is displayed. An inner loop is used so that
each criterion displays its specific information in a separate row along with its score
information. The score information for each criterion is first retrieved from the database
using five queries. These queries utilize the rubriccriteria-id foreign key from the
evaluation-score table to match all scores associated with the specific criterion. The
first query retrieves the total number of scores available. The second query counts the
number of scores equal to two. The third query count the number of scores equal to one.
The fourth query counts the number of scores equal to three. The fifth query counts the
number of scores equal to four. With this information, the total number of scores as well
as the percentages of each grouping are calculated and displayed.
The Analysis selection provides access to a number of data analysis tools for faculty
users. This section uses a step-by-step process to apply data filters for the user. After
retrieving all the information from the outcome database table, the first step lists each
73
outcome with a radio button selection option. Once the selection is submitted, it is
processed in the processevaluation.php file. The selected outcome is saved as a session
variable and the data analysis proceeds to the next step. Step two matches the
outcomeid foreign key in the rubricform table to the saved outcome from step one.
The rubricformid foreign key from the rubric criteriacategory table is matched
against the found rubric forms. The rubric_categoryid foreign key from the
rubric-criteria table is matched against the categories found. The rubric criteria id from
the evaluationscore table is matched against the criteria found. With a set of scores
retrieved, the headerid values from the evaluationscore table results are used to
retrieve the courseid from the evaluationheader table. The courseid from the
evaluationheader is used to retrieve the course information from the course table. This
course information is displayed as a drop-down menu in step two along with the results
from step one. If there are no courses available for the given outcome, then an error
message is displayed requesting the user select a different outcome. The query to
generate step two is:
select distinct course.courseid, coursenumber, coursetitle
from evaluationheader,rubric_form, rubriccriteria category,
rubriccriteria, evaluationscore, course
where (
('rubric form' .outcomeid = ".$_SESSION[DATAANALYSISSLO].") and
(rubric form.'rubricformid' = 'rubriccriteria_category'. 'rubricform id') and
(rubric criteriacategory.'categoryid'='rubric criteria'. 'rubric-categoryid')
and (rubriccriteria. 'criteriaid' = evaluationscore. 'rubriccriteriaid') and
(evaluation score.'headerid' = 'evaluationheader' .'header id') and
('evaluationheader.' courseid' = course'. course id'))
order by course-number";
74
When the user selects a course with the submit button, the process file saves the course
ID in a session variable and moves to the next data analysis step. Step three displays the
results of the previous steps and generates a drop-down menu of semester/year
combinations by querying the evaluation-header table for distinct semester/year
combinations that are associated with the saved course ID. With the semester/year
combination is selected, the processed form saves the year and semester in session
variables and moves to the final step. Step four is a drop-down menu of the available
data analysis tools including the mean, median, mode, percentage, and raw data. When
the user selects the result type and clicks on submit, the result type is saved in a session
variable, the results are calculated, and then displayed in the Data Results form.
To generate the data results, the first step is to create a list of evaluation header IDs and
rubric form information. This is accomplished with the following query to the database:
select distinct title, rubric formid, headerid from rubric_form,
evaluationheade where (
(outcome id = ".$_SESSION[DATA ANALYSIS SLO].") and
(course id = ".$_SESSION[DATAANALYSISCOURSE].") and
(semester = "'.$ SESSION[DATAANALYSISSEMESTER]."') and
(year= "'.$_SESSION[DATAANALYSISYEAR]."')
)";
The results are parsed into rubric information and an array of header IDs. Next, the
categories are retrieved selecting all categories whose rubricform_id matches the saved
rubric form ID. With the rubric form information, the first row of the data results table
lists the program, the rubric form title with the outcome information displaying when the
mouse hovers over the title, and the data result type. Next, each category is looped
75
through and another row of heading is added to the table with the category name
followed by the appropriate data result columns. Within each category loop the criteria
for the specific category is retrieved. An inner loop is used to display the results for
each criterion. The data scores for each criterion are retrieved using a query to the
database which matches the headerid from the evaluationscore table to the list of
headerids previously saved as well as matching the rubriccriteriaid to the current
criterion.
The mean data result type computes the average score, i.e., the total score value is
divided by the number of scores in the data set. The resulting average is then displayed
next to the criterion.
The median data result type reports the value in which there are an equal number of
values above and below it. In order to calculate this value, a table called scores
containing the data values is created. In addition, a table called medians is also created.
The create table command for the medians table is as follows:
create table medians
select x.rubriccriteriaid, x.score as medians
from scores x, scores y
where x.rubriccriteriaid=y.rubric_criteriaid
group by x.rubriccriteriaidx.score
having sum(y.score <= x.score) >= count(*)/2
and sum(y.score >= x.score) >= count(*)/2;
This table creates rows of criteriaid, score pairs. It uses the scores table twice and
groups the results so that it can find values in which there are an equal number of values
76
above and below it. Once this table is created, it is used to generate criteriaid, median
pairs with the following query, "select rubriccriteriaid, avg(medians) as median from
medians group by rubriccriteria id." The results are then saved in an array and
displayed with each matching criteria-id.
The mode data result type reports which score value(s) are the most frequently
occurring. To calculate these results, the data is retrieved in score, frequency pairs that
are grouped by score in descending order. The first pair is the mode. The following.
pairs are checked for equal frequency. If so, then the score is'added to the mode.
The percentage data result type utilizes multiple queries. The first query retrieves the
total number of scores available. The second query counts the number of scores equal to
two. The third query counts the number of scores equal to one. The fourth query counts
the number of scores equal to three. The fifth query counts the number of scores equal
to four. With this information, the total number of scores as well as the percentages of
each grouping are calculated and displayed.
The raw data result type is unique in that no rubric form is displayed. The score
information is retrieved and listed with the associated evaluationheader information in a
table format. The fields are criterion ID, criterion name, instructor, team ID, date,
evaluation type, and score.
77
At the bottom of the result types is a form that allows the user to select another result
type without changing the existing data filters. The submit button will generate and
display the new data results. The reset button will return the user to step one of the data
analysis preparation, and cancel reloads the current page.
The Enter Course Information selection is a form with a table of existing courses
listed below it for reference. The course department is a drop-down menu that is
generated by retrieving the enumerated field options from the database. This prevents
data entry errors for the course department. The course number, title, and description are
editable text fields. These are not tested for they are only used to display the contents in
various tables and does not create a security risk. When submit, reset, or cancel is
selected, the page proceeds to the processevaluation.php file where it is processed. If
the submit variable is set, then the processed form saves the information in the course
table. Otherwise, the Enter Course Information page is reloaded.
The Update Course Information selection is a multiple step process. The first form
requires the user to select a department from the drop-down menu or the checkbox
selecting all of the departments. The drop-down menu is generated by retrieving the
enumerated department options from the course table and displaying the results. When
the course or checkbox is selected with the submit button, the form is processed in the
processevaluation.php file. If the checkbox is selected, then all the course information
is retrieved, otherwise the selected department and matched against the department field
78
in the course table to retrieve all the courses that are associated with the selected
department. With this information retrieved, a table is displayed with each row being a
separate form with update and delete buttons to the right of the course information. If the
delete button is selected, then the information for the specific course is saved in session
variables along with the session variable, DELETECHECK, which is set to true. At
this point, a verify deletion form loads requiring that the user verify the course ID to be
deleted. If the deletion is cancelled, then the session variables are cleared and the initial
update course page is displayed. If the deletion is approved, then the session variables
are used to complete the deletion process and are then cleared. If the update button is
selected, then a new form is loaded. This form starts with a department drop-down
menu. The drop-down menu prevents data entry inconsistency errors. The following
fields are course number, course title, and description. All the fields are preloaded with
the existing information for the specific course selected. The user then modifies the
fields as appropriate. The last three editable fields are not tested for they are only used
to display the contents in various tables and does not create a security risk. When
submit, reset, or cancel is selected, the page proceeds to the processevaluation.php file
where it is processed. If the submit variable is set, then the processed form updates the
information in the course table. If the cancel button is selected, then the current form
reloads with the original information. The reset button returns the user to the original
update course page.
79
The Enter Team Information selection is a form with the tables of existing team names
grouped by course listed below it for reference. The course is a drop-down menu that is
generated by querying the database for existing courses. The use of a drop-down menu
prevents data entry errors for the course, which is critical since the entry is used as a
foreign key to the course table. The team name is an editable text field. It is not tested
for it is only used to display the contents in various tables and does not create a security
risk. When submit, reset, or cancel is selected, the page proceeds to the
processevaluation.php file where it is processed. If the submit variable is set, then the
processed form saves the information in the evaluationteam table. Otherwise, the Enter
Team Information page is reloaded.
The Update Team Information selection is a multiple form process. The first form
requires the user to select a course from the drop-down menu or the checkbox selecting
all of the courses. The drop-down menu is generated by querying the course table and
displaying the results. When the course or checkbox is selected with the submit button,
the form is processed in the process evaluation.php file. If the checkbox is selected,
then all team information is retrieved and grouped by the course, otherwise the course ID
is saved from the form and matched against the courseid foreign key field in the
evaluationteam table to retrieve all the teams that are associated with the selected
course. With the information retrieved, tables are displayed with each row being a
separate form consisting of an editable team name text box with the original name
preloaded, the date the team name was originally added, and update and delete buttons to
80
the right. If the delete button is selected, then the information for the specific team is
saved in session variables along with the session variable, DELETECHECK, which is
set to true. At this point, a verify deletion form loads requiring that the user verify the
team to be deleted. If the deletion is cancelled, then the session variables are cleared and
the initial update team page is displayed. If the deletion is approved, then the session
variables are used to complete the deletion process and are then cleared. If the update
button is selected, then the form is processed and the information is updated in the
evaluationteam table. If the user does not want to update or delete a team name from
the selected course(s), then either select a new course using the form at the top of the
page or select a different course of action from the horizontal and vertical navigation
menus.
The Prepare Evaluation Form for Print selection is a form used to produce a printer
friendly version of a given rubric form. There are fields that can be filled in by data
entry users prior to the evaluation. The number of students per group is a drop-down
menu which allows for groups of one to nine people. The course is a drop-down menu
populated by a query requesting all existing courses. The rubric form is also a dropdown menu populated by a query requesting all rubric forms. Finally, semester and year
are drop-down menus for when the evaluation is taking place. With all fields being
drop-down menus, the form data cannot be entered in an incorrect format or with invalid
information. When the form is submitted, it is processed in the process_evaluation.php
file. The form data is saved in session variables and the printer friendly form is loaded.
81
To assist the evaluators, the printer friendly form includes a link in the upper left corner
which displays available printing options. In addition, rubric form title, the course,
semester, and year are already filled in the requested rubric form header. The rubric
form ratings column includes a box for each student in a group when the criterion is
rated individually. The printed forms are used by evaluators in the specific course. The
results of the completed forms are used when entering the score information.
The Enter Score Information selection allows the user to enter completed evaluation
forms. The process starts with the Prepare Score Form screen. The user uses one of the
completed forms to select the appropriate selections. The course and rubric form dropdown menus are generated by queries requesting existing course and rubric form
information from the database. The evaluator type and semester drop-down menus are
generated by retrieving the enumerated values of evaluator-type and semester,
respectively, from the evalution header table. The number of students, date of the
assessment, and year from the semester/year combination are drop-down menus that are
populated without accessing the database. All the fields in this form are drop-down
menus which ensure that the selected data will be of the proper format and are valid
options. The semester/year combination is tested against the selected semester to verify
accuracy. By design, spring is determined to be between January and June, and fall is
determined to be between July and December. If those fields are not appropriate, then
an error message displays and the user needs to fix the entry before continuing. If
submit is selected, then the form information is saved in session variables along with a
82
session variable flag indicating that this stage is complete and the Enter Score Form is
loaded. If there is an error, then an error session variable flag is set. If cancel or reset is
selected, then both flags are cleared and the Prepare Score Form is reloaded. With no
errors present, the Enter Score Form preloads the information saved from the Prepare
Score Form. In addition, there is an instructor editable text box and a team drop-down
menu, which is generated by retrieving all teams associated with the specified course.
Below the form header information, the specified rubric form is displayed with dropdown menus for each score. Again, the use of the drop-down menu is to ensure accurate
information. When the user initially completes the fields and selects submit, the form is
processed in the processs evaluation.php file. With the first set of scores, the header
information is saved in the evaluationheader table and the new ID is saved in a session
variable. Each score is saved in the evaluationscore table along with the team and
header information, both of which are foreign keys into the evaluationteam and
evaluationheader tables. Once the information is processed, the user returns to the
Enter Score Form page. The user can enter the scores from other evaluation forms. The
instructor is saved from the first set of scores and is now automatically entered into the
form. Only the team name and scores need to be entered. When the last evaluation form
from this course is entered, the user selects the radio button at the bottom indicating this
is the last form. The information is still saved when submitted, but the user is redirected
to the original Prepare Score Form after the information is processed. With the
conclusion of this set of evaluation data, the session variables are cleared. If the reset
button is selected at any time, then the session variables are also cleared and the Prepare
83
Score Form is displayed. If the cancel button is selected, then the current form is
reloaded with the original information.
3.8.
Login
Login is a function that is used for faculty and data entry users. It allows them to
authenticate and gain access to restricted areas of the application. The form is a dropdown menu of the two user types, Faculty and Data Entry. The password is an editable
text box. The user selects the appropriate user type, enters the password, and selects the
submit button. Once submitted, the form is processed in the process-login.php file. The
user type and password combinations are verified against constants set in the
define.inc.php file. Once confirmed, the appropriate session variable is set. The session
variable is tested throughout the application before allowing access to the restricted
areas. If cancel or reset is selected, then the default, index.php, page is loaded. Note
that when a login attempt is successful, the logout link in the horizontal navigation menu
includes the authorized user type, as shown in Figure 48. This is so that the user has a
visual cue indicating a successful login.
84
IEe
.1
I
8
111111111110
-l"FRI".
-- ___
U-13
Fd& TV
Yew
1tor
oitnarks
Iool
fAccessty
deli
SA~~SCRAMENTO STATEserhF
0
taLeadeshippbeginshere.
i1E
search
11
Mission I Goals I Objectives I Outcomes I Performance Criteria I Assessment Plan I Evaluation I Login I Logout Faculty
Home
Computer Science Program
Department Mission
Department Mission Statement
College Mission
This is the department mission.
University Mission
California State University, Sacramento 16000 J Street I Sacramento, CA 95819 1 (916) 278-6011
Figure 48. Login indicator
3.9.
Logout
When a user selects Logout from the horizontal navigation menu, the link goes to the
processlogout.php file for processing. The application session variables are all cleared.
The session cookie is destroyed and then the session itself is destroyed. Finally, the page
is redirected to the default index.php file.
3.10. Database design
The third layer of a three-tier web application architecture is the database. In this
project, a MySQL database is used. The database is designed in a top-down manner, as
shown in Figure 49. This is a basic view of the database layout. At the top is the
objective table. A given objective may have one or more attachments associated with it.
In addition, history items are added whenever the status changes for an objective or
outcome. Currently, the history table is not utilized, but the information exists in the
event that it is needed in the future. Rubric forms are based on a single outcome and
85
comprise of multiple criteria-categories. Various criteria are grouped by a single
criteria-category. This is the relationship between objectives, outcomes, and rubric
forms which comprise of criteria-categories and criteria. Rubric forms are used to
evaluate student performance on specific criteria. The data gathered from these forms is
analyzed. There is a weak link between the student teams and the course. A team must
be associated with a course, but a course may not have any teams; therefore teams are
dependent on the course. However, each evaluation score contains a foreign key to the
team table in the event that it is a team rated criterion. The unique elements of each
score is the team, criterion, and score value. The non-unique elements of a score are the
course, instructor, evaluator-type, semester, year, and date of the evaluation. These
elements are grouped in the evaluationheader table to reduce redundancy in the
database. Each score contains a foreign key that links to an associated
evaluationheader ID.
86
Outcome
History
Objective
descrip0*1
objective id
110
objective number
the database design pisshown inFigure
A detailed view of
source
Thisviewtdail
Rubri Crtei CaeoyRurcFr
Rubric Criteria
|ttchen
50.
otiomenume
criteanoaid
attachmentiid
cantbe associatedwithnneormoreattaexceeds_description
esamdescription
filernamelisps
categorynin
rubricformeiv
d outcome
roubricfomi
title
betee
eid
below_description
1.1 rating_typer
Evaluation Header
headerdid
ieithglwa
objecte
objective
is associated with at leastoneoutcomeandeachoutcomeisassociCourse
Evaluation Score
Evaluation
t also givesthe deal
key
foreign
relationhips.
dthe twcalsahi
coresa,
theu
course-id
ftotbe
ntsoni
rasamayt-aytabegoreltosiynow
oceama
rurca crieri
asoiatd
ucmbtti
i
coucredwthasinl
tablesad ceat tw
net
objecive
s assciatdwitat
forine
key
mrelationsives.
ai
n-omn
indousto
n
the relatinshesi
courseormreatahens
mapingtabemsteiteewe
the
tabls.
tw Thi breas a may-to-ate-enable corelatioshipint
obectieris
h
e
sntawy
an iabed rtitmonesthiap.ent
tw
yoe-t-any
date-assese
an
tye
reas
49e Database,deind- baschotmeiascaedwh
rltoshonip, thebai
maytwo-mablsnot
alompiensathe dertaileo
ITo
betweenthobeivanoucm
canbje asseocitcoed wthableormoeatstahmelatioshimppsgtbemsxs
tetotables
one aw-to-many table relationships.t
. This breates
wooetomn
87
Outcome
Objective-outcome map
Objective
PK
PK
obiective id
P~KJ
obiective outcome mao id
outcome number
description
source
assessment-report-id
outcomeid
objective-id
active
objective-number
description
assessment report id
outcome id
| History
PK
history id
outcomeid
objectiveid
status change
detail
I date
Objective attachment map -PK
objective attachment id
IF
-,
-. Attachment
PK
attachment id
evaluationscore
score id
PK
score
rubriccriteriaid
teamid
headerid
J1
evaluationheader
PK
Iheader
*0
PKrubrc form id
tte
outcome-id
<rubric criteria
Rubric_criteriacategory
criteria id
PK
*-
PK
Rubric Form
Outcome
No
Course
PK
team id
teamname
dateentered
courseid
cateaorv id
category
rubricformid
criterianame
exceeds description
meetsdescription
progress description
belowdescription
rating_type
rubriccategoryid
evaluation team
id
courseid
instructor
evaluator-type
semester
year
dateassessed
Objective
rubricform
date
assessment-reportjid
filename
objective_id
attachmentid
active
PK
Th
0
Course
IN
Figure 50: Database design - detailed
I
course id
department
coursenumber
coursetitle
course description
*
88
Chapter 4
TESTING
Testing can be achieved through a number of methods. For the purpose of this project,
each functional area will be discussed and their testing methods described. There are a
few source code checks that are done for every page. Each header tag incrementally
decreases in size. If header tag levels are skipped, such as HI followed by H3, then
accessibility tools may have trouble converting the webpage. For tables, the use of
header tags (<th>) are verified. These headers are utilized in screen readers and are
visually distinctive for those that do not use screen readers.
4.1.
Mission
Each mission statement link is verified to be a valid link. The information displayed is
static, so further testing is not required.
4.2.
Goals
Each goals statement link is verified to be a valid link. The information displayed is
static, so further testing is not required.
4.3. Objectives
The Department, College, and University objectives links in the vertical navigation bar
are verified to be valid. The College and University objective information is static, so
89
further testing is not required. For the Department objectives, the table is verified to
match the objectives table in the database.
The View Attachments selection is tested by checking the results of each individual
objective as well as checking the results when the checkbox for all objectives is selected.
Attachments may be the result of an industrial visit, surveys, or other types of
assessment data. The attachment information displayed is verified to match the
attachment table in the database. The correlation of attachments to objectives is verified
in the objective attachment map table in the database. The reset and cancel buttons are
tested to ensure that the selected objective is reset.
The Maintain Objectives section tests the objective number. The objective number is
verified to be preloaded with the next available number. If the user submits an entry
with an objective number containing anything except a number, then an error message in
red appears and the objective number in question turns red, as shown in Figure 51.
90
- -
Ble Ldt
yew
W rity Biy ea
IRoe
t
1,
STATE
0-O SACRAMENTO
Leadership begins here.
Bach
|
go
Mission I Goals I Objecties I Outcomes I Performance Criteria I Assessment Plan I Evaluation I Login I Logout Data Entry
Home
Computer Science Program
Public
Department
Objectives
College
Objectives
University
Objectives
Program Educational Objectives
Data Entry
Maintain
Objectives
View
Attachments
Enter
Attachments
Maintain
Attachments
Add New Objective
Please enter a number for the objective
Enter the objective number Flb
Enter objective description IThis is a test
Add objective FSuibmt I
Update Objective
Objective
Description
To be a ignificant contributor in ene or more of the aspects associated with the
adevelep ent, maintenance, and support of real world computing systems
~
~
- --- - - - - *- ------ ----
To be
-- --
-------C
eneffective and contributing member Of a project tem.
an
UPDATE
DELETE
A NCEL
UPDELATE
rPDELETE
_
__
__
_
__
__
__---------
CANCEL
Figure 51. Test - maintain objective
The status buttons are also tested. The cancel button reloads the original information
and stays on the current page. The update and submit buttons save the information given
that there are no errors. When the mouse hovers over the delete button, it turns red as
shown in Figure 52.
l
91
_WN
.
Ede Lsc Yew mgmtory l
-
k
tool
.-_-
,
bdsu
SACRAMENTO STATE
90
gI
a-h
Leadership begins here.
Mission I Goals I objevties I Outcomes I Performance Cnteia I A ssessent Plan I Evaluation I Login I Logoot Data Entry
Computer Science Program
Home
Public
Department
Objectives
College
Objectives
University
Objectives
Data Entry
Maintain
Objectives
View
Attachments
Enter
Attachments
Maintain
Attachments
Program Educational Objectives
Add New Objective
Enter the objective number
Enter objective description
[
_
_… -_
…___-
.
Add objective submal
Update Objective
Objective
F1
Description
To be a snigificant contributor in one or aore of the aspects associated with the
development, mfintenanee, and support of real world computing system,.
Figure 52: Test - delete objective
When the delete button is selected, a verification page displays requesting the user to
verify the deletion, as shown in Figure 53. If the user clicks yes, then the associated
objective is deleted. If the user clicks no, then the application returns to the previous
page.
EOa
t
IC,
itrlly
edoeksIorls
bU*
i QFISACRAMENTO STATE
[readership
begins here.
rws
-
Mssion I Goals I Objectives I Outcomes I Performance Crteria I Assesnsment Plan I Evaluation I Login I Logout Data Entry
Home
Department
Program Educational Objectives
Objeetives
College Objectives
Verify Deletion
University Objectives
Do you want to delete
Data Entry
I
Computer Science Program
Maintain Objectives
View Attachments
Enter Attachments
Maintain Attachments
objective
5 To be a significant contributor in one or more of the aspects associated with the development, maintenance, and support
of real world computing systems.
YESJLLJ
Cohifnla
Stt. Unlte, S.sr.rnts I 60002 s oet I SOm- nto, CA9X9191(916) 270-6011
Figure 53: Test - verify deletion
go
I
92
The Enter Attachments section tests the file being uploaded. The file must follow the
file requirements stated below the browse button and cannot have the same name as a
file that already exists in the database and on the server. An objective is not required for
the attachment file to be uploaded. The data entry user may be instructed to upload a file
before the associated objectives have been determined. The reset and cancel buttons are
verified to reload the page. The submit button is tested to ensure that when selected the
file is saved on the server and that the information is accurately saved in the database. If
there is an error with the file, then no information is saved and an error message is
displayed explaining the problem.
The Maintain Attachments section is tested at each stage. The first stage verifies that
all the attachments are listed in the drop-down menu. The delete button is tested to make
sure that once the selected attachment is verified for deletion, it is deleted from the
server and the database. The update button is tested to make sure that the next page
loads with the information of the selected attachment. The second stage, updating an
attachment, is verified that the correct file information is listed. In addition, the list of
objectives is checked to ensure that the list displays the correct descriptions and that the
checkboxes are preselected with the correct settings from the database. The cancel
button is verified to reload the page with the original information. The update button is
verified that when selected any changes made are correctly saved in the database tables.
93
4.4.
Outcomes
The Department, College, and University outcomes links in the vertical navigation pane
are verified to be valid. The College outcomes information is static, so further testing is
not required. For the Department outcomes, the table is verified to match the outcomes
table in the database. The View Objective-Outcome Matrix information is verified to
match the objectiveoutcome map table as well as the corresponding foreign keys in the
objective and outcome tables. The outcomes are also visually inspected to ensure that
they are displayed as lower case letters instead of numbers. The anchor links in the
matrix table and below the matrix table are verified to go to the appropriate tables (e.g.,
Program Educational Objectives table and Student Learning Outcomes table). In
addition, the links going back to the matrix are verified. The View Objective-Outcome
Table information is verified to match the objectiveoutcome map table as well as the
corresponding foreign keys in the objective and outcome tables. The outcomes are also
visually inspected to ensure that they are displayed as lower case letters instead of
numbers.
The Enter Outcome selection tests the outcome number. The outcome number is
verified to be preloaded with the next available number. If the user submits an entry
with the objective number containing anything except a number, then an error message
in red appears as the outcome number in question turns red, as shown in Figure 54.
94
~~~_ini~
EdU E&
s
i
0SACRAMENTO STATE
Sew
f
ibuy
femwaks
IX
Aacessiv
btel
e.-rh
Leadership begins here.
I
Mission I Goals I Objectives I Outcomes I Performance Criteria I Assessment Plan I Evaluation I Login I Logout Data Entry
Home
Public
Department
outcomes
College
Outcomes
i
*
University
Learning
Goals
View
ObjectiveOutcome
Matrix
Computer Science Program
Student Learning Outcomes
Add New Outcome
Please enter a number for the outcome
Enter the outcome number 3d
Enter the outcome source |BETdD-
View
ObjectiveOutcome
Table
Data Entry
Enter
Outcome
Enter the outcome description -
Update
Outcome
_
.
FSUBMiT|
.
RESET
.
.
CANCELC
.
I
-
I
I'
t!-
Figure 54. Test - enter outcome
The status buttons are also tested. The cancel and reset buttons reload the original
information and stay on the current page. The submit button saves the information given
that there are no errors. The outcome tables below the status buttons are verified that the
information is displayed correctly and that it is updated automatically when a new
outcome is added.
The Update Outcome selection tests the outcome number. The information from the
outcome table is verified to be accurately preloaded. If the user tries to update an entry
with the objective number containing anything except a number, then an error message
in red appears as the outcome number in question turns red, as shown in Figure 55. The
status buttons are also tested. The cancel button reloads the original information and
95
stays on the current page. The delete button goes to a verify deletion page. If the user
verifies the deletion, then the specific outcome is deleted. Otherwise, the original page
reloads. The update button saves the information given that there are no errors.
D1
Edt
H450
1r
I
&ndntro
Y b*
A SACRAMENTO STATE
Leodershipbeginshere.
serb|7
11
Mission I Gools Objecti-es I Ootcooes I Performance Citnlda I AssessmreotPIn. I Eolooti.on I Login I LogootData Entry
Home
Pulrtcent Outcomes
Computer Science Program
Student Learning Outcomes
College Outcomes
Update Outcome
University Learning
Goals
Please enter a number for the outcome
View ObjectiveOutcome Matrix
View ObjectiveOutcome Table
outmAE
_
Souce
An
Dnt.l Entry
Description
bility to apply knowledge of nooputieg nd atheortino
appropriate to the .1
Enter Outcome
Update Outcome
Update ObjectiveOutcome Matrix
U
DELETE
11-E1|docpilme
CANCEL
An ability to .n-lyze n problem, and identify and defi-e
requireents appropriate to ito
Aj solution
_
_
the .o.puting
UPDATE
DELETE
_.ET
B
'ANEL
Figure 55. Test - update outcome
The Update Objective-Outcome Matrix selection is tested at each stage. In step one,
the drop-down menu is verified to display each objective correctly. The cancel and reset
buttons are verified to reload the page. The submit button continues to the next stage. In
step two, the displayed objective information is verified to match the selection from step
one. The list of outcomes is checked to ensure that the list displays the correct
descriptions and that the checkboxes are preselected with the correct settings from the
database. The cancel button is verified to reload the page with the original information.
The reset button is verified to reload the page from step one. The submit button is
verified that any changes are saved correctly to the database tables.
96
4.5.
Performance Criteria
The View Rubric Form selection is tested by selecting and checking the results of each
rubric form. The rubric form displayed is verified to match the title from the
rubricform table, the categories from the rubriccriteria category table, and the
appropriate criteria for each criteria-category from the rubriccriteria table. The rubric
form is verified that the overall layout is correct. The reset and cancel buttons are tested
to ensure that the selected rubric form is reset.
The View Criteria-Category option is tested by selecting and checking the results of
each rubric form as well as the checkbox displaying all categories for all rubric forms.
The categories displayed for each selected rubric form are verified to be correct. The
reset and cancel buttons are verified that they reset the page.
The View Criteria option is tested by checking the results of each criteria-category
selected as well as the checkbox displaying all criteria for all categories. The criteria for
each selected category are verified to be correct. The reset and cancel buttons are
verfied that they reset the page.
The Start Rubric Form option verifies that an outcome is selected before the new form
is saved. If an outcome is not selected, then an error message displays, as shown in
Figure 56. The cancel and reset buttons are verified that they reload the page.
97
i;
iUi
,:Fi&A^W-
rie
ji-w
dit
0
-
tryv
Wo*ks
Jacs
ij
-
-.
l
SACRAMENTO
STATE
Leadership begins here.
.
9
g
I
Mission I Goals I Obje.Wies I Ou0tcoies I Perfonranr. Critera I Assessment Pi.n I EsmalUatin I Login I L[gout Data Entr.y
Home
Computer Science Program
Public
Start New Rubric Form
Data Entry
View Rubric Form
View
Criteria-Category
View Criteria
Start Rubric Form
Update Rubric Form
Maintain
Criteria-Categories
Enter Criterion
Update Criterion
An outcome must be selected to continue
Step 1: Select an outcome
a: An ability to apply knowledge of computing and mathematics appropriate to the discipline
r b: An ability to analyze a problem, and identify and define the computing requirements appopriate to its solution
c: An ability to design, implement, and evaluate a computer-based system, process, component, or program to
meet desired needs
C d: An ability to function effectively on teams to accomplish a common goal
e: An understanding of professional, ethical, legal, security, and social issues and responsibilities
f: An ability to communicate effectively with a range of audiences
g: An ability to analyze the local and global impact of computing on individuals, organizations, and society
h: Recognition of the need for and an ability to engage in continuing professional development
i An ability to use current techniques, skills, and tools necessary for computing practice.
r j: An ability to apply mathematical foundations, algorithmic principles, and computer science theory in the modeling
and design of computer-based systems in a way that demonstrates comprehension of the tradeoffs involved in design
choices
C k: An ability to apply design and development principles in the construction of software systems of varying
complexity.
Step 2: Enter the title of the new rubric form
Enter the tide of the rubric for the selected outcome
Is~iti
I
II
i
'R
j
J6Eii II
Rubric Titles
F'131
ORIC
1_mtoel
I
[IOral
Communication _if)
IWritten Communicationl l_(f) j
I
I
c
3g|Tes~b
<_(a)_L
I
I
r
C.Tif-nl. Stte Unl-ers-v,
.vno 1 6000 J Seteet I Sacramento CA 9e819
1 (916) 278-6011
Figure 56: Test - start rubric form
The Update Rubric Form option is tested on the first page by selecting each rubric
form and selecting the submit button. The reset and cancel buttons are verified to reset
the page. The second page displays the title and associated outcome which may be
modified as needed. The cancel button is verified to reload the current page with the
original information. The reset button is verified that it returns the user to the page
requesting a rubric form be selected. The submit button is verified that it saves any
changes made and then returns to the page requesting a rubric form be selected.
I
98
The Maintain Criteria-Categories selection tests the Enter Category Information
section by verifying that the rubric drop-down menu lists all the existing rubric forms.
The cancel and reset button are tested to reload the page, and the submit button is
verified that when selected the new category information is properly saved in the
database. The Update Category Information section is also verified in that the rubric
drop-down menu list is complete. In addition, the checkbox is verified that it triggers all
the categories to be listed when the submit button is clicked. The reset and cancel
buttons are tested to reload the current page. Once a category is listed, it is tested to
ensure that the cancel button reloads the current page with the original information. The
update button is verified that any changes to the specific category are saved correctly.
The delete button is verified that it deletes the specific category once the user verifies
that the category should be deleted.
The Enter Criterion option is tested by verifying that all the criteria-categories and all
the rating types (e.g., team, individual) are listed. The reset and cancel buttons are
verified that they reload the current page. The submit button is verified that it saves the
form information into the database.
The Update Criterion option is tested by verifying that all the criteria-categories are
listed. In addition, each criteria-category is selected as well as the checkbox to verify
that the correct criteria are listed after the submit button is selected. The reset and cancel
buttons are verified that they reload the current page. Once the criteria are listed, the
99
delete button is tested to ensure that the specific criterion is deleted once the user verifies
the deletion request. The update button is verified to load a page with the selected
criterion information. This page is tested by verifying that all the criteria-categories and
all the rating types (e.g., team, individual) are listed. The submit button is verified that it
saves the form information into the database. The reset button is checked that it returns
the user to the original update criterion page. The cancel button is checked that it
reloads the page with the original information.
4.6.
Evaluation
The View Evaluation Data selection is tested by checking the oral communications
rubric form. It is verified that the title from the rubric-form table, the categories from
the rubriccriteria category table, and the appropriate criteria for each criteria-category
from the rubriccriteria table in the database all correspond to the oral communications
rubric form. The table is verified to use table header tags (<th>) correctly and that the
overall layout of the table is correct. The results are checked by doing a separate
MySQL query outside of the application. The reset and cancel buttons are tested to
ensure that the selected rubric form is reset.
The Analysis link in the vertical navigation pane is tested at each step. In step one, a
student learning outcome must be selected to continue. The cancel and reset buttons are
tested to make sure the selection is cleared. The submit button tests that the outcome
selection is remembered and that the user continues to the next step. The test for step
two is to verify that the selection for step one and the course drop-down menu are
100
correctly displayed. The cancel button is verified that it clears the course selection and
stays on the current page. The reset button is verified that it returns to step one. The
submit button is verified that the course selection is remembered and the user continues
to step three. The test for step three is to verify that the selection of step one and two
and the semester/year drop-down menu are correctly displayed. The cancel button is
verified that it clears the semester/year selection and stays on the current page. The reset
button is verified that it returns to step one. The submit button is verified that the
semester/year selection is remembered and the user continues to step four. The test for
step four is to verify that the selection of step one, two, and three and the result type
drop-down menu display correctly. The cancel button is verified that it clears the result
type selection and stays on the current page. The reset button is verified that it returns to
step one. The submit button is verified that the result selection is remembered and the
user continues to appropriate data results page. For each step, the drop-down menus are
verified against the database to make sure that the selections of the previous steps are
incorporated into query that controls the current drop-down menu options. Once initial
data results are displayed, each result type is tested in turn. The tables are verified to be
formatted uniformly and correctly. The results are verified through a MySQL query
separate from the application.
For the data entry users, the ability to add, delete, and modify items are tests. In the
Enter Course Information section, the course department drop-down menu is verified
to list all the departments correctly. The reset and cancel buttons are verified to reload
101
the page. The submit button is verified to save the information correctly in the
database. The List of Courses table is verified that it automatically updates when a new
course is added.
The Update Course Information section is first tested by verifying that all the
departments are listed in the drop-down menu and that each selection, including the
checkbox for all departments, displays the correct course information when the user
clicks the submit button. The reset and cancel buttons are verified to reload the page.
When the list of courses is displayed, the delete button is tested to verify that it requests
verification from the user before proceeding to delete the selected course. If the user
cancels the deletion, then it is verified that the current page is reloaded. The update
button is verified to display a new page preloaded with the selected course information
and that the department drop-down menu lists all the departments. The cancel button is
tested to reload the current page with the original information. The reset button is tested
to ensure it reloads the original update course information page. The submit button is
verified that when clicked any changes made are saved to the database.
In the Enter Team Information section, the course drop-down menu is verified to list
all the courses correctly. The reset and cancel buttons are tested that they reload the
page. The submit button is tested that the information is saved correctly in the database.
The Current List of Teams table is verified that it automatically updates when a new
team is added.
102
The Update Team Information section is first tested by verifying that all courses are
listed in the drop-down menu and that each selection, including the checkbox for all
courses, displays the correct team information when the user clicks the submit button.
The reset and cancel buttons are tested that they reload the page. When the list of team
names is displayed, the delete button is tested to verify that it requests verification from
the user before proceeding to delete the selected team. If the user cancels the deletion,
then it is verified that the current page is reloaded. The update button is verified that
when selected any changes made are saved to the database.
The Prepare Evaluation Form for Print selection is tested by verifying that each dropdown menu lists the correction information. The cancel and reset buttons are verified
that they reload the current page. The submit button is verified to trigger a new page to
load that utilizes all the options selected from the previous page. The printable page is
visually tested in that the format and fields are filled in correctly. The link in the upper
left corner is verified to offer printing options.
The Enter Score Information selection is tested by verifying that each drop-down
menu lists the correct information. The cancel and reset buttons are verified that they
reload the current page. The submit button is verified to trigger the loading of the Enter
Score Form page. When the Prepare Score Form is processed, the semester is checked
against the selected assessment date. The spring semester is verified to be between
103
January and June, and the fall semester is verified to be between July and December. If
this is not the case, then the user is returned to the Prepare Score Form with the user
selected fields and an appropriate error message. If there are no errors, then the user
continues to the Enter Score Form. This page is visually checked that the options from
the previous page are loaded and formatted correctly. In addition, the instructor field is
ensured to be editable and the team name drop-down menu lists only the team names for
the selected course. The scores for each criterion are verified to list the values of one to
four. The reset button is tested that it reloads to the original page. The cancel button is
tested that it reloads the current page with all fields set to the original values. The
submit button saves the information from the page and is verified by running database
queries to ensure that all the data is saved correctly. Finally, the radio button indicating
the last page of data to enter is set and verified that when the submit button is selected,
the form information is saved properly and the original page reloads so that new options
can be selected.
4.7.
Login
When the Login link in the horizontal navigation pane is selected, there are two user
type choices. Both the faculty and data entry logins are tested with correct and incorrect
passwords to verify that the username/password combinations work properly. Once a
login is successful, each horizontal link is tested to ensure that the correct information is
available to the user.
104
4.8.
Logout
When the Logout link in the horizontal navigation pane is selected, the view returns to
the public interface. This is tested by selecting each option in the horizontal navigation
pane and verifying that only public information is available.
105
Chapter 5
CONCLUSION
The purpose of this project is to develop a data analysis tool for assessment. It has three
tiers of users: public, data entry, and faculty. The public can view non-sensitive
assessment information. The data entry-tier can insert, delete, or modify information.
The faculty tier can view both non-sensitive and sensitive information.
It is designed using a three-tier web application architecture. The presentation layer is
the user interface available via the internet. The business layer is the PHP processing
that is done in the background. This is the layer that sends and receives requests
between the presentation layer and the third layer, the data layer. The data layer is a
MySQL database. Overall, it utilizes a LAMP (Linux, Apache, MySQL, PHP) open
source web platform.
In addition, this project is useful and user-friendly. On many levels, this is a valuable
tool for assessment. The public can view the multiple levels of missions, goals,
objectives, and outcomes. They can see how the Program is built within the College
which is built within the University. This tool assists the public to understand how the
three entities work together as a unit. For those entering and maintaining the data, the
forms are designed to be intuitive and easy to follow. The majority of the fields are
drop-down menus which reduce the possibility of entry errors and contribute to a
database with accurate and reliable information. The faculty benefit from the accurate
106
and stable database with data analysis reports that they can use with confidence. The
various data analysis result types provide multiple ways of viewing the same data points
which assists in the proper evaluation of a given criterion.
5.1.
Future work
This project is a preliminary development of a data analysis tool, and, therefore, there.
are areas where additional work can continue. A few areas already have been coded, but
have not been utilized yet. For example, there is a history table that continues to be
populated with status changes to the objectives and outcomes. In the future, the data
may be used for historical purposes with a graphical interface to access and monitor the
information. In terms of graphical views, the data analysis portion could include
histograms, charts, and graphs for a more visually appealing representation of the data
results. Another visual improvement would be to add color to the printable versions of
the rubric forms and data results.
Other possibilities for future work include adding additional sources of data, such as
surveys or course-outcome equations and evaluations. The course-outcome questions
would be separate from rubric forms and would have a different data entry format.
Another option would be to add an additional layer so that multiple departments could
use the same application. The different engineering departments are already included in
the design. This would allow for a different department to be added to the application or
to use a separate instantiation of this project in which only minor changes are required.
107
APPENDICES
108
APPENDIX A
FILE LAYOUT
This section lists the file names along with a short description for each file. It also
includes a detailed explanation of how the Sacramento State template is structured and
how each template function is used as part of the overall webpage design.
A.]
General information
The include files all end with the .inc.php. The .inc is to note it as an include file. The
.php is so that Dreamweaver will display the file with the appropriate color coding.
images/*: All image files are part of the Sac State template and located in this folder.
includes/db.inc: Reports MySQL errors, connects and disconnects from the database.
includes/define.inc.php: Contains the definitions of constants and lists session variables.
includes/ ecsassess.sql: SQL file containing the create table statements for the database.
includes/includes.inc: Lists all of the other include files being used.
includes/template.inc.php: Contains the header, body, and footer functions for the
template page layout.
includes/utiltitv.inc.php: Contains shared functions, such a form elements, etc.
index.php: Default application page primarily used when no specific file name is
specified in the URL.
webstyles.css: Cascading style sheet which defines a constant look & feel of webpages.
109
A.2
Template layout
The web pages utilize the Sac State template. As a result, the website pages have the
following format:
echo DisplayHeader(;
-
start outer table
outer table - row 1
o inner table - horizontal navigation menus
* green horizontal navigation menu
* white horizontal navigation menu
echo Display[Section]Navigation(;
-
outer table - row 2, data cell 1
o beige vertical navigation menu
echo DisplayStartContent(;
-
outer table - row 2,
o start data cell 2
echo [Display Body];
- continue to fill row 2, data cell 2
echo DisplayEndContent(;
-
end data cell 2
end outer table - row 2
echo DisplayFooter(;
-
A.3
outer table - row 3 (blank space)
outer table - row 4
o inner table - footer information
end outer table - row 4
end outer table
Assessment Plan
Assessment Plan is a future feature that is listed in the horizontal navigation menu but
currently contains place holder files.
includes/assessment.inc.php: Contains the functions related to the assessment plan
section.
110
assessment plan.php: Displays the current place holder information
A.4
Attachments
includes/attachment.inc.php: Contains the functions related to attachments.
attachment_view.php: Displays the form to view attachments.
attachmententer.php: Displays the form to upload a new attachment.
attachment update.php: Displays the form to update or delete an attachment
process attachment.php: Processes the attachment forms.
A.5
Evaluation
includes/evaluation.inc.php: Contains the functions related to evaluation.
evaluation.php: Displays the starting page from the evaluation horizontal navigation
menu. A different page loads depending on the user type.
evaluation analysis.php: Displays the forms to view data analysis results.
evaluation course enter.php: Displays a form to add a course.
evaluation course update.php: Displays forms to update or delete a course.
evaluation print form.php: Displays a printer-friendly version of a rubric form.
evaluation print prepare.php: Displays a form to prepare for the print version of a rubric
form.
evaluation team enter.php: Displays a form to add a new team.
evaluation score enter.php: Displays forms to enter rubric form data scores.
evaluation team update.php: Displays a form to update a team.
process evaluation.php: Processes the evaluation forms.
111
A.6
Goals
includes/ goals.inc.php: Contains the functions related to goals.
goals college.php: Displays the College goals.
goals department.php: Displays the Department goals.
goals university.php: Displays the University goals.
A. 7
Login
includes/login.inc.php: Contains the functions related to logging in.
login.php: Displays the login page.
process login.php: Processes the login form.
A.8
Logout
process logout.php: Processes the logout request.
A.9
Mission
includes/mission.inc.php: Contains the functions related to missions.
mission college.php: Displays the College mission statement.
mission department.php: Displays the Department mission statement.
mission university.php: Displays the University mission statement.
A.10
Objectives
includes/objective.inc.php: Contains the functions related to objectives.
objective college.php: Displays the College objectives.
objective maintain.php: Displays the forms to add, update, or delete an objective.
112
objective university.php: Displays the University objectives
objective department.php: Displays the Department objectives.
process objective.php: Processes the objective forms.
A.11
Outcome
includes/outcome.inc.php: Contains outcome and objective-outcome mapping functions.
,objective outcome matrix.php: Displays the View Objective-Outcome matrix.
objective outcome table.php: Displays the View Objective-Outcome table.
outcome college.php: Displays the College outcomes.
outcome department.php: Displays the Department outcomes.
outcome enter.php: Displays the form to add a new outcome.
objective outcome update.php: Displays the form to update the objective-outcome
mapping.
outcome university.php: Displays the University outcomes.
outcome update.php: Displays the forms to update or delete an outcome.
process outcome.php: Processes the outcome and objective-outcome mapping forms.
A.12
PerformanceCriteria
includes/criteria.inc.php: Contains the functions related to performance criteria.
criteria category maintain.php: Displays the forms to add, update, or delete a category.
criteria category view.php: Displays the forms to view criteria-categories.
criteria criterion enter.php: Displays the form to add a new criterion.
criteria criterion update.php: Displays the forms to update or delete a criterion.
113
criteria criterion view.php: Displays the forms to view criteria.
criteria rubric start.php: Displays the form to start a new rubric form.
criteria rubric update.php: Displays the forms to update or delete a rubric form.
criteria rubric view.php: Displays the forms to view a selected rubric fonn.
process criteria.php: Processes the performance criteria formrs.
114
APPENDIX B
DATABASE TABLES
Appendix B provides the details of each database table.
Table 2. Attachment table
Column Name
Attachment id
Type
Integer ( 11)
Default
auto-increment
Date
Date
Null
File name
Char(255)
Null
Assessment report id
Integer(H
1)
Null
Notes
primary key
Table 3. Course table
Default
auto-increment
Column Name
Course id
Department
Type
integer(1 1)
Enum
Coursenumber
Char(5)
_;,,
Course title
Char(80)
Null
Course description
Text
Null
Notes
primary key
not null
Table 4. Evaluation header table
Column Name
header-id
Type
integer(1 1)
course id
Instructor
Evaluator-type
integer( 11)
Char(80)
Enum
Semester
Year
Date assessed
Enum
Integer(4)
Date
Default
autoincrement
Notes
primary key
not null
(faculty,instructor,student,alumni,
industry)
Spring, Fall
Not null
Nut null
Table 5. Evaluation score table
Column Name
Score id
Score
header id
Rubric criteria id
Type
integer(1 1)
ENUM
integer(1 1)
Integer(1 1)
Default
auto-increment
Team id
Integer( 11)
Null
Notes
primary key
(1,2,3,4)
not null
NULL
115
Column Name
Team id
6. Evaluation
Type
integer( 11)
Team name
Date entered
Course id
Char(80)
DATE
Integer(l 1)
Table
team table
Default
auto-increment
Notes
primary key
____
NULL
Not null
Table 7. Histor table
Column Name
Historyid
Type
integer(1 1)
Default
auto-increment
outcome id
integer(l 1)
Null
objectiveid
Statuschange
integer(l 1)
Enum
Null
Other
Detail
Text
Null
Date
Timestamp
Current timestamp
Notes
primary key
"Added,
Modified,
Deleted,
Other"
Table 8. Objective table
Column Name
objectiveid
Type
integer( 11)
Objective number
Description
Assessment report id
integer(1 1)
Char (160)
Integer(1 1)
Default
auto-increment
Notes
primary key
not null
Null
null
Table 9. Objective attachment map table
Column Name
objectiveattachment mapid
Type
integer( 11)
Default
auto-increment
objective id
Attachment id
integer(1 1)
integer(l 1)
Null
Null
Active
Tinyint
0
Notes
primary
key
116
Table 10. Objective outcome map table
Column Name
Type
objective outcome mapid integer(l 1)
outcome id
integer(1 1)
objective id
integer(l 1)
Tinyint
Active
Table
Column Name
Outcomeid
Outcomenumber
Description
Source
Assessment report id
Default
auto-increment
Notes
primary key
not null
; not null
0
11. Outcome table
Default
auto-increment
NULL
NULL
Type
integer(1 1)
Integer(l 1)
Text
ENUM
Integer( 11)
Notes
primary key
(CACABET)
NULL
Table 12. Rubric criteria table
Column Name
Criteria id
Criteria name
Exceeds description
Meets description
Progress description
Belowdescription
Ratingtype
Type
integer( 11)
Char(80)
Char(255)
Char(255)
Char(255)_
Char(255)__
ENUM
Rubric categoryid
Integer(
Default
auto-increment
Notes
primary key
_____
_
_
_
_
__
___
__
(team,
individual)
1)
Table 13. Rubric criteria category table
Column Name
Categoryid
Category
Rubricform id
Type
integer(l 1)
Char(l120)
Integer(I 1)
Default
auto-increment
F
_
Notes
primary key
N
Not null
_
Table 14. Rubric form table
Column Name
Rubric form id
Title
Outcome-id
Type
integer(l 1)
Char(120)
Integer( 11)
Default
auto-increment
"
l
|
t
Notes
primary key
Not null
117
BIBLIOGRAPHY
[1] ABET Board of Directors. (2008, Nov.). Criteria for Accrediting Computing
Programs. ABET. Inc. Baltimore, MD. [Online]. Available:
http ://www.abet.org/Linked%20DocumentsUPDATE/Criteria%20and%20PP/COO 1 %2009- 10%20CAC%20Criteria%2012-01 08.pdf
[2] ABET Board of Directors. (2007, Nov.). Criteria for Accrediting Engineering
Programs. ABET. Inc. Baltimore, MD. [Online]. Available:
http ://www.abet.org/Linked%20DocumentsUPDATE/Criteria%20and%20PP/EOO 1 %2008-09%20EAC%20Criteria%2012-0407.pdf
[3] "About MySQL." MySQL. October 6, 2007 < http://www.mysql.com/companv/>.
[4] "Apache Web server." Webopedia. July 14, 2005. October 6, 2007.
http://www.webopedia.com/TERM/A/Apache Web server.html
[5] "Apache HTTP Server" Wikipedia. October 5, 2007. October 6, 2007
<http://en.wikipedia.org/wiki/ Apache_HTTPServer>.
[6] "Citing Web resources." Lafayette College Libraries& Academic Information
Resources. September 06, 2007. October 6, 2007
<http://ww2.lafayette.edu/-library/guides/cite.html>.
[7] Elmasri R. and Navathe S.B., Fundamentals of DatabaseSystems, 4th ed.
Boston:Addison Wesley, 2003, pp. 49-83.
[8] Han J. and Kamber K. Data Mining: Concepts and Techniques. 2nd ed. San
Francisco, CA: Morgan Kaufmann Publishers, 2006.
[9] "Home." Open source initiative. October 6, 2007 <http://www.opensource.org/>.
[10] "Introduction to PHP." W3Schools. October 6, 2007
<http://www.w3schools.com/php/phpintro.asp>.
[11] "Linux." Wikipedia. October 5, 2007. October 6, 2007
<http://en.wikipedia.org/wiki/Linux>.
[12] "Linux." SearchEnterpriseLinux.comDefinitions. October 11, 2006. October 6,
2007 <
http://searchenterpriselinux.techtarget.com/sDefinition/0,,sid39 gci212482,00.html>.
118
[13]
"MySQL." Wikipedia. September 30, 2007. October 6, 2007
<http://en.wikipedia.org/wiki/MySQL>.
[14]
"Open source." Wikipedia. October 3, 2007. October 6, 2007
<http://en.wikipedia.org/wiki/Open source>.
[15] "PHP." Wikipedia. October 6, 2007. October 6, 2007
<http://en.wikipedia.org/wiki/PHP>.
[16]
"Sacramento State Web Templates." Sacramento State - Web Central:Sac State
Templates. January 25, 2008. October 25, 2008
<http://www.csus.edu/web/templates-sacstate.html#designs>.
[17] "The Median, the Mean and the Mode." About.com:Mathematics. 2008. October
30, 2008 <http://math.about.com/library/weekly/aa020502a.htm>.
[18] "What is the open source technology model?" eXtropia. October 6, 2007
<http://www.extropia.com/aboutus/opensourcetech.html>.
[19] "Why Use Linux?" Why Use Linux I CAE. September 7, 2008
<http://www.cae.wisc.edu/whyuselinux>.
Download PDF
Similar pages