Assessment

Presentations, Reports, Studies

Presentations

Docia Rudley, Cassandra Hill, Tau Kadhi, “Using Assessment to Develop and Measure Students’ Acquisition of Practical Lawyering Skills,” presentation to the Institute for Law Teaching Summer Conference at New York Law School, June 1-2, 2011.

 Docia Rudley, Cassandra Hill, “Using Outcomes Assessment to Develop and Measure Students’ Foundational Lawyering Skills: A Programmatic Approach,” presented at the Inaugural Conference of the Center for Excellence in Law School Teaching at Albany Law School, March 29-30, 2012.   

Reports

Thurgood Marshall School of Law data reports are housed in the Educational Resources Information Center (ERIC) database.  A few of the report references are given below, but complete reports can be retrieved at http://www.eric.ed.gov/.

Rudley, D., Garrison, P., Mathews, S., Kadhi, T., & Holley, D. (2012).  Thurgood Marshall School of Law Empirical Findings:  Statistics for the ABEST Report (On file with Office of the Dean)
Summary:
 As part of the annual report for the Texas Legislative Budget Board (LBB) ABEST (Automated Data Budget Entry System), the Office of Assessment reports values for TMSL graduate bar passage to the office of the Dean.  These statistics summarize the 8th version of the raw data file, displaying a thorough evaluation of the Texas bar passage rate for TMSL bar takers twelve months out from graduation.    

Rudley, D., Kadhi, T., & Holley, D. (2012).  Thurgood Marshall School of Law Empirical Findings:  Response to AALS Questionnaire (On file with Office of the Dean)
Summary: 
In response to the 2012 AALS questionnaire (re: TMSL’s membership application to AALS)  Office of Assessment report provides bar examination statistics for years 2007 to 2010, indicating the pass rates for first time takers and for repeat takers.

Rudley, D., Johnson, M., Duruigbo, E., Kadhi, T., & Holley, D. (2012).  Thurgood Marshall School of Law Empirical Findings:  Analysis of Second Year MPT Data and a Comparative Analysis of the MPT data for  2011 and 2012.  (On file with Office of Assessment)
Summary:
 As part of an ongoing evaluation of the foundational skills, professors in the TMSL Business Associations course, with the assistance of the Office of Assessment, administered the Multistate Performance Test (MPT) to the entire cohort of second year students.   Office of Assessment conducted a statistical analysis of test results and compared the performance data with MPT data collected during the spring semester of the students’ first year.  

Rudley, D., Kadhi, T., & Holley, D. (2012).  Thurgood Marshall School of Law Empirical Findings:  A Study of the Impact of the Bar Scholarships during the years 2005-2009.  (On file with the Office of the Dean)
Summary:
This follow-up study to the previous bar scholarship study evaluated the impact of bar scholarships on the first-time bar passing rate.  This study focused on a yearly comparison of the bar pass rate of those who received the bar scholarship and those who did not. 

Rudley, D., Kadhi, T., & Holley, D. (2012).  Thurgood Marshall School of Law Empirical Findings:  A Categorical Analysis of the February 2012 Bar Results. (on file with the Office of the Dean)
Summary:
 As part of the ongoing systematic analysis by the Office of the Dean of TMSL student performance on the Texas bar examination, this report provides a statistical analysis of  TMSL bar taker performance on the February, 2012 Texas bar examination, by subject matter category.

Rudley, D., Kadhi, T., & Holley, D. (2012).  A Comparative Analysis of the February 2011 and February 2012 Bar Results and Test Takers. (On file with the Office of the Dean)
Summary:
In an effort to further evaluate the changes in bar scores for the Texas Bar examination between February 2011 and February 2012, the Office of Assessment provided descriptive statistical comparisons of the sub scores and differences, reporting significant changes.  In addition, this study evaluated admissions values, student performance in law school, and curricula differences as factors.

Rudley, D., & Kadhi, T. (2011).  The Thurgood Marshall School of Law Empirical Findings:  The Analysis of the 2011 LSSSE Survey Results. Houston, TX:  Thurgood Marshall School of Law – Assessment. (On file with the Office of Assessment)
Summary:
  This study provides a more focused evaluation of Law School Survey of Student Engagement (LSSSE) results. Faculty and administrators were asked to respond to a series of questions from the LSSSE survey regarding students’ classroom experiences and experiences with administration by predicting the students’ responses to those questions.  The students’ actual responses were then compared with the predicted responses.  A chart showing the comparison between the student and faculty/administrator responses was included. The purpose of the study was to engage faculty and administrators with the LSSSE data and to provide a snapshot of student perceptions about the law school experience at TMSL.

Rudley, D., Kadhi, T., & Holley, D. (2011).  Thurgood Marshall School of Law Empirical Findings: A Comparative Analysis of the July 2010 and July 2011 Bar Results and Test Takers. (on file with the Office of the Dean)
Summary:
  In an effort to further evaluate the changes in bar scores for the Texas Bar examination between July 2010 and July 2011, the Office of Assessment provided descriptive statistical comparisons of the sub scores and differences, reporting significant changes.  In addition, this study evaluated admissions values, student performance in law school, and curricula differences as factors.

Rudley, D., Kadhi, T., & Holley, D. (2011).  The Thurgood Marshall School of Law Empirical Findings:  The Analysis of the 2010-2011 Pre-Post MPT Test Results. Houston, TX:  Thurgood Marshall School of Law – Assessment. (On file)
Summary:
This initial study provides data on student performance and growth during the 2010-2011 academic years on a range of foundational skills measured by the Multi-State Performance test.  1L students were given an MPT pre-test during 1L orientation and results were compared with results from a post test given in the spring of the 1L year.  In an effort to normalize grading, the MPTs were graded by a team of practicing attorneys who were taken through a norming process, using standardized scoring rubrics. 
Descriptive statistics were reported and a paired sample test of significance showed significant change in organization and format and in overall scores.

Rudley, D., Hill, C., & Kadhi, T. (2011).  The Thurgood Marshall School of Law Empirical Findings:  An Analysis of Lawyering Process Client Letter.  (On file with the Office of Assessment)
Summary:
As part of an ongoing evaluation of the foundational lawyering skills of TMSL students, Office of Assessment conducted a programmatic evaluation of student performance in Lawyering Process.  Using a spring semester writing assignment (a client letter), the project measured the students’ skills in the following areas: legal analysis, factual analysis, organization and format.  Lawyering Process professors from each section participated in the process, which involved developing a norm-referenced letter (an anchor letter) to be used as a grading standard.  The letters were graded by three outside evaluators, all of whom were practicing attorneys.  The project was presented at the Conference on Law School Teaching at New York Law School in June, 2011.

Kadhi, T., & Holley, D., (2010).  The Thurgood Marshall School of Law Empirical Findings: A Report of the Statistical Analysis of the July 2010 TMSL Texas Bar Results.  Houston, TX: Thurgood Marshall School of Law – Assessment. (ERIC Document Reproduction Service No. ED519811)
Summary:
The following report gives descriptive statistical findings of the July 2010 TMSL Bar results. The report sought to address the following research questions: 1. What are the statistical descriptors of the July 2010 overall TMSL bar students? a. What was the difference in scoring of the overall versus the First-Time Bar students? 2. What is the relationship of the subcategories, Times Taken the Bar, and Final Bar Score for the July 2010 TMSL Bar test takers? 3. What five subcategories were the best predictors of the July 2010 TMSL overall bar test scores? 4. What were the statistical descriptors of the July 2010 TMSL First-Time Bar students (FTBs)? a. What was the difference in scoring of the Overall versus the First-Time Bar students? 5. What is the relationship of the subcategories and the Final Bar Score for the TMSL FTBs? 6. What five subcategories were the best predictors of the July 2010 TMSL bar test scores for the FTBs?  The findings are used as part of continual analysis of TMSL bar scores.

Kadhi, T., Holley, D., & Beard, J. (2010). The Thurgood Marshall School of Law Empirical Findings: A Six-Year Study of the First-Time and Ultimate Bar Exam Results of Students According to Law School Admission Council (LSAC) Index.  Houston, TX: Thurgood Marshall School of Law – Assessment. (Eric Document Reproduction Service No. ED515213)
Summary:
This report focused on the matriculating classes of 2001-2007 according to their Law School Admission Council (LSAC) index. It offered information on the first time bar and ultimate performance on the Bar Exam of these TMSL students, grouping them according to their graduating GPA and LSAC index. This report addresses the following research questions: 1. What are the bar pass percentages of a normal sample of the matriculating classes of 2001-2007 according to their LSAC index and their first-time and ultimate performance on the bar examination? a. What was the lowest LSAC index that produced a 75% first time bar pass rate? 2. What are the descriptive statistics of a normal sample of the matriculating classes of 2001-2007 according to their LSAC index and their graduating GPA? a. What percentage of students admitted with an index of below 2.5 finished with a graduating GPA of less than 2.5? 3. What is the statistical relationship between below 2.5 index scores and below 2.5 graduates to the bar passage?  Data has implications for decision-making in TMSL admissions.

Kadhi, T., Palasota, A., Holley, D., & Rudley, D. (2010). The Thurgood Marshall School of Law Empirical Findings: A Report of the Waston-Glaser for the 2009-2010 Test Takers.  Houston, TX: Thurgood Marshall School of Law – Assessment. (Eric Document Reproduction Service No. ED513411)
Summary:
This report gives statistical findings of the 2009-2010 Watson-Glaser test. We addressed the following research questions: 1. What are the statistical descriptors of the Watson-Glaser results of student Pre-Test and Post-Test (Within and Between)? 2. What is the relationship of the categories (Inference Making -- IM, Assumption Recognition -- AR, Deductive Reasoning -- DR, Interpretation -- IN, and Argument Evaluation -- AE) of the Watson-Glaser Pre and Post Test data? 3. What categories indicated statistically significant differences from Pre to Post Test?  Statistical evaluation of this examination allows for Assessment to report on the cognitive growth of our students in these reasoning skills. 

Kadhi, T., Rudley, D., Holley, D., Krishna, K., Ogolla, C., Rene, E., & Green, T. (2010). The Thurgood Marshall School of Law Empirical Findings:  A Report of the 2012 Friday Academy Attendance and Statistical Comparisons of 1L GPA (Predicted and Actual). Houston, TX: Thurgood Marshall School of Law – Assessment. (Eric Document Reproduction Service No. ED513410)
Summary:
These descriptive statistics focused on the attendance of the 2012 class and the average actual and predicted 1L grade point averages (GPAs). We addressed the following research questions: 1. What are the attendance and GPA statistical characteristics of the students who were targeted by the Friday Academy at TMSL for the class of 2012? 2. What are the relationships between attendance in the Friday Academy at TMSL and their GPAs? 3. Is there a statistically significant difference between the targeted 2012 class students who attended and those who did not? 4. What is the relationship between attendance in the Friday Academy at TMSL and the GPAs of students attending at least half the time vs. those who did not. This type of statistical analysis helps in evaluating the efficacy of academic support and academic programming initiatives.

Kadhi, T., Holley, D., Rudley, Garrison, P., & T. Green (2010).  The Thurgood Marshall School of Law Empirical Findings: A Report of the Statistical Analysis of the February 2010 TMSL Texas Bar Results. Houston, TX: Thurgood Marshall School of Law – Assessment. (ERIC Document Reproduction Service No. ED511342)
Summary:
This report gives the statistical findings of the February 2010 Thurgood Marshall School of Law (TMSL) Texas Bar results. The following research questions were addressed: 1. What are the statistical descriptors of the February 2010 TMSL Bar students? 2. What is the relationship of the subcategories, Times Taken the Bar, and Final Bar Score in the February 2010 TMSL Bar test takers? 3. What subcategory served as the best predictor of the February 2010 TMSL Bar test taking students to their Final Bar Score?

Kadhi, T., Holley, D., Palasota, A., Garrison, P., & T. Green (2010).  The Thurgood Marshall School of Law Empirical Findings: A Report of the Correlational Analysis of Bar Passing Rates and Final GPA of Years 2005-2009. Houston, TX: Thurgood Marshall School of Law – Assessment. (ERIC Document Reproduction Service No. ED511344)
Summary:
This report gives the Correlational Relationship (R) between the bar pass rates and GPAs for the years 2005-2009. This report of findings was done to see if there are any significant relationships between the three variables (Bar Pass/Fail/Unknown, Overall GPA, and Bar GPA).

Kadhi, T., Holley, D., Garrison, P., & T. Green (2010).  The Thurgood Marshall School of Law Empirical Findings: A Report of Bar Passing Percentages of Years 2005-2009--Updated May 2010. Houston, TX: Thurgood Marshall School of Law – Assessment. (ERIC Document Reproduction Service No. ED511348)
Summary:
These descriptive statistics give the overall passing percentages of the bar examination for the Thurgood Marshall School of Law (TMSL) for the calendar years of 2005-2009.  This report serves as a continual update of the progress of the Law School’s American Bar Association (ABA) Accreditation standards.

Kadhi, T., Holley, D., Garrison, P., & T. Green (2010).  The Thurgood Marshall School of Law Empirical Findings: A Report of Differences of Texas Bar Passing Percentages of Students Receiving the TMSL Scholarship during the Years 2005-2009 versus Those Not Receiving the TMSL Scholarship. Houston, TX: Thurgood Marshall School of Law – Assessment. (ERIC Document Reproduction Service No. ED511343)
Summary:
This report of descriptive/inferential statistics provides information concerning students receiving the Thurgood Marshall School of Law (TMSL) scholarship and those who did not, focusing on the relationship between their bar passing rates and GPAs. The timeline observed are the calendar years of 2005-2009.
Those students who received the scholarship passed at a rate 11.9% higher than those who did not.  Although these descriptive stats support an initial idea of giving scholarships produces better results, inferential statistics show that there is no statistical significance found between the two groups.  Implications for this study were in administrative decision-making.

Kadhi, T., Holley, D., Garrison, P., Green, T., & A. Palasota (2010).  The Thurgood Marshall School of Law Empirical Findings: An Updated Report of the Bar Passing Percentages of Years 2005-2009. Houston, TX: Thurgood Marshall School of Law – Assessment. (ERIC Document Reproduction Service No. ED511347)
Summary:
The second report of the descriptive statistics of the overall passing percentages of the bar examination for the Thurgood Marshall School of Law (TMSL) for the calendar years of 2005-2009.  There are updates to this report on file or published.
There were implications in academics and accreditation.

Kadhi, T., Holley, D., Garrison, P., Green, T., & A. Palasota (2010).  The Thurgood Marshall School of Law Empirical Findings: A Report of the Bar Passing Percentages of Years 2005-2009. Houston, TX: Thurgood Marshall School of Law – Assessment. (ERIC Document Reproduction Service No. ED511346)
Summary:
The second report of the descriptive statistics of the overall passing percentages of the Bar examination for the Thurgood Marshall School of Law (TMSL) for the calendar years of 2005-2009.  There are updates to this report on file or published.
There were implications in academics and accreditation.

Kadhi, T., Holley, D., & A. Palasota (2010).  The Thurgood Marshall School of Law Empirical Findings: A Report of the Relationship between Graduate GPAs and First-Time Texas Bar Scores of February 2010 and July 2009. Houston, TX: Thurgood Marshall School of Law – Assessment. (ERIC Document Reproduction Service No. ED511345)
Summary:
The following report gives statistical findings concerning the graduating Grade Point Averages (GPAs) of the February 2010 and July 2009 TMSL First Time Texas Bar Test Takers and their Bar scores. We researched these questions: 1) What are the statistical descriptors of the first-time February 2010 and July 2009 TMSL Bar students' GPAs in conjunction with their Bar scores? and 2) What is the relationship of the final GPA of the first time bar test Takers and their GPAs?