Research on the MAPT-CCR | All About the MAPT-CCR

Since 2003, in addition to the technical manuals, we have produced over 80 research reports on the MAPT, listed below. All of these are available upon request from the Center for Educational Assessment (CEA) at UMass.

2003

Hauger, J. B., & Keller, L. A. When to test incoming adult basic education students: An analysis of the literature. [Center for Educational Assessment research report No. 495]
Keller, L. A., & Zenisky, A. L. Toward a psychometrics of assessment for adult basic education. [Center for Educational Assessment research report No. 496]
Sireci, S. G., & Zenisky, A. L. Defining criteria for meaningful gain in Massachusetts Adult Basic Education Programs. [Center for Educational Assessment research report No. 497]
Sireci, S. G., Baldwin, P. Preliminary Specifications for ACLS Mathematics and Numeracy Proficiency Tests. [Center for Educational Assessment research report No. 510]
Valle, M., & Sireci, S. G. Preliminary specifications for ACLS Reading Proficiency Tests. [Center for Educational Assessment research report No. 511]

2004

Sireci, S. G., Baldwin, P., Keller, L. A., Valle, M., Goodridge, B., Leonelli, E., Schmitt, M. J., Tamarkin, K., & Titzel, J. Specifications for the ACLS Mathematics and Numeracy Proficiency Tests. [Center for Educational Assessment research report No. 513]
Sireci, S. G., Li, S., Martone, A. , Valle, M. Bayer, J., Kelly, J., Hanley, S., Greene, S., Royer, J. M., & Schwerdtfeger, J. Specifications for the ACLS Reading Proficiency Tests. [Center for Educational Assessment research report No. 516]
Hambleton, R. K., & Jirka, S. J. How to do your best on tests: Some suggestions for adult learners. [Center for Educational Assessment research report No. 517]
Sireci, S. G. ACLS, SABES, and UMASS: Perfect together! [Center for Educational Assessment research report No. 519]
Zenisky, A. L., Keller, L. A., & Sireci, S. G. More than just a number: Interpreting test scores in ABE/ESOL assessment. [Center for Educational Assessment research report No. 520]
O’Neil, T., Zenisky, A. L., & Sireci, S. G. Viability analysis of current computer-based testing options for adult basic education in the state of Massachusetts. [Center for Educational Assessment research report No. 535]
Zenisky, A. L., Hambleton, R. K., & Sireci, S. G. Computerized testing options for adult basic education assessment in Massachusetts. [Center for Educational Assessment research report No. 536]
Martone, D., Goodridge, B., Moses, M., & Titzel, J. Refinements to ABE mathematics standards for assessment purposes. [Center for Educational Assessment research report No. 548]
Valle, M., Sireci, S. G., Bayer, J., Kelly, J., Hanley, S., & Greene, S. Proposed refinements to ABE Reading Test Specifications: Revisions to the Reading Standards for Assessment. [Center for Educational Assessment research report No. 555]
Sireci, S. G., Baldwin, P. Preliminary Specifications for ACLS Mathematics and Numeracy Proficiency Tests. [Center for Educational Assessment research report No. 510]
Valle, M., & Sireci, S. G. Preliminary specifications for ACLS Reading Proficiency Tests. [Center for Educational Assessment research report No. 511]

2005

Han, K.-T., Sireci, S. G., Wells, C. S., & Zenisky, A. L. Evaluating educational gains at the program level. [Center for Educational Assessment research report No. 559]
Zenisky, A. L., & Sireci, S. G. No adult left behind, either: Creating large-scale computer-based tests for adult basic education students. [Center for Educational Assessment research report No. 563]
Han, K., Sireci, S. G., Wells, C. S., & Zenisky, A. Methods for evaluating educational gains at the program level. [Center for Educational Assessment research report No. 572]
Baldwin, P., Martone, D., Zenisky, A., Sireci, S. G., & Hambleton, R. K. Massachusetts Adult Proficiency Tests: Summary of spring 2005 pilot test results. [Center for Educational Assessment research report No. 583]
Zenisky, A. L., & Baldwin, P. Using item response time data in test development and validation: Research with beginning computer users. [Center for Educational Assessment research report No. 593]

2006

Sireci, S. G., Baldwin, P., Martone, D., Hambleton, R. K., & Zenisky, A. L. Massachusetts Adult Proficiency Tests Technical Manual. [Center for Educational Assessment research report No. 600]
Martone, D., Sireci, S. G., & Delton, J. Methods for evaluating the alignment between state curriculum frameworks and state assessments. [Center for Educational Assessment research report No. 603]
Sireci, S. G. Test accommodations and the Massachusetts Proficiency Test for adults. [Center for Educational Assessment research report No. 607]
Han, K., Baldwin, P., & Sireci, S.G. Analyses of differential item functioning of potential MAPT items. [Center for Educational Assessment research report No. 612]
Martone, D., Smith, C., Kaira, L., Sireci, S. G., Coffee, N., Haller, H., Hartwick, L., O’Brien, A., McGill, D., Stearns, D., & Schwerdtfeger, J. Proposed revised specifications for MAPT for reading. [Center for Educational Assessment research report No. 614]
Han, K. T. Establishing educational gain levels on newly developed assessments for ABE. [Center for Educational Assessment research report No. 615]
Han, K. T., Baldwin, P., & Sireci, S. G. Analyses of differential item functioning of potential MAPT items. [Center for Educational Assessment research report No. 616]
Han, K. T. Using 3-level hierarchical linear models for evaluating educational gain at the program level. [Center for Educational Assessment research report No. 628]

2007

Sireci, S G., Martone, A., Smith, C., Kaira, L., Coffey, N., Haller, L. H., Hartwick, L., O’Brien, A., McGill, D., Stearns, D., & Schwerdtfeger, J. Proposed revisions to the MAPT for reading test specifications. [Center for Educational Assessment research report No. 632]
Sireci, S. G., Baldwin, P., Martone, D., & Han, K. Establishing achievement levels on a multi-stage computerized-adaptive test: An application of the Item Descriptor Matching Method. [Center for Educational Assessment research report No. 634]
Sireci, S. G., Wells, C. S., Baldwin, P., & Han, K. T. Evaluating item parameter drift in computerized-adaptive testing. [Center for Educational Assessment research report No. 640]
Sireci, S. G., Baldwin, P., Martone, D., Zenisky, A. L., & Hambleton, R. K. Awarding points for educational gain to Massachusetts Adult Education Programs: Issues and recommendations. [Center for Educational Assessment research report No. 641]
Han, K. T., & Sireci. S. G. Statistical models for evaluating educational gain at the program level for Adult Basic Education Programs. [Center for Educational Assessment research report No. 655]
Kaira, L. T., & Sireci, S. G. Evaluating the content validity of a multistage adaptive test. [Center for Educational Assessment research report No. 656]
Shea, C. M., & Sireci, S. G. Combining standard setting and content validity studies. [Center for Educational Assessment research report No. 657]
Wells, C. S., Sireci, S. G., & Han, K. T. Identifying item parameter drift in multistage adaptive tests. [Center for Educational Assessment research report No. 663]
Liang, T., Wells, C.S., & Sireci, S. G. Evaluating item parameter drift in computerized adaptive testing. [Center for Educational Assessment research report No. 683]

2008

Delton, J. Using response time to examine examinee effort. [Center for Educational Assessment research report No. 667]
Lam, W., Li., S., & Sireci, S. G. Evaluating decision consistency and decision accuracy on a multistage test. [Center for Educational Assessment research report No. 668]
Deng, N., & Hambleton, R. K. Checking the dimensionality of the Massachusetts Adult Proficiency Test with both real and simulated data. [Center for Educational Assessment research report No. 673]
Martone, A., Sireci, S. G., & Griffin, L. Exploring the process and results of teachers’ participation in an assessment-standards alignment study. [Center for Educational Assessment research report No. 676]
Deng, N., & Hambleton, R. K. Checking the dimensionality of the Massachusetts Adult Proficiency Test with both real and simulated data. [Center for Educational Assessment research report No. 673]
Sireci, S. G., Baldwin, P., Martone, D., Zenisky, A. L., Lam, W., Lewis, C., Han, K., & Hambleton, R. K. Massachusetts Adult Proficiency Tests, Technical Manual: Version 2. [Center for Educational Assessment research report No. 677]
Martone, D., Marcotte, A., Copella, J., Sireci, S. G., Greene, S., McIsaac, M., Crevison, E., Kocik, J., Haberstroh, S., & Schwerdtfeger, J. Developing test specifications for a beginning literacy reading assessment for adult learners in Massachusetts: Summary of February 2008 meeting. [Center for Educational Assessment research report No. 685]
Zenisky, A. L., Sireci, S. G., & Martone, D. Test accommodations for the MAPT: Review and recommendations for next steps. [Center for Educational Assessment research report No. 686]
Zenisky, A. L., Yoo, H., Meng, Y., Sireci, S. G., & Martone, D. Massachusetts Adult Proficiency Test (MAPT) item bank status report. [Center for Educational Assessment research report No. 692]
Zenisky, A. L., Copella, J., & Marcotte, A. Beginning literacy reading assessment for the Massachusetts Adult Proficiency Test: Assessment design options. [Center for Educational Assessment research report No. 693]
Shea, C., Sukin, T., Martone, A., Sireci, S. G., & Zenisky, A. L. An item level comparison of the GED practice tests and the Massachusetts Adult Proficiency Tests. [Center for Educational Assessment research report No. 704]
Patton, J. M., & Parker, P. A proposal for the use of innovative item formats on the Massachusetts Adult Proficiency Test for Mathematics and Numeracy. [Center for Educational Assessment research report No. 705]

2009

Meng, Y., Schweid, J., & Zenisky A. L. An empirical comparison of measurement precision for two multi-stage test designs. [Center for Educational Assessment research report No. 706]
Shea, C. L., & Sireci, S. G. The Massachusetts Adult Proficiency Tests (MAPT) concurrent validity study. [Center for Educational Assessment research report No. 708]
Martone, D., Zenisky, A. L., Randall, J., Copella, J., Meng, Y., Parker, & Sukin, T. Score reporting for the MAPT: Focus group results. [Center for Educational Assessment research report No. 711]
Zenisky, A. L., Martone, D., Sireci, S. G., Lam, W., & Baldwin, P. Massachusetts Adult Proficiency Tests Technical Manual Supplement: 2008-2009. [Center for Educational Assessment research report No. 715]
Zenisky, A. L. Massachusetts Adult Proficiency Test (MAPT) FY09 item bank status report. [Center for Educational Assessment research report No. 718]
Keller, L. A., Copella, J., & Semerjian, A. Using generalizability theory to determine the stability of percent correct statistics for the Mathematics MAPT. [Center for Educational Assessment research report No. 719]
Meng, Y., Zenisky, A. L., Schweid, J., & Sireci, S. G. Comparison of measurement precision in a multi-stage adaptive test. [Center for Educational Assessment research report No. 727]
Meng, Y., Zenisky, A. L., Schweid, J., & Sireci, S. G. Evaluating measurement precision across the original and revised multistage-adaptive test designs for the Massachusetts Adult Proficiency Tests. [Center for Educational Assessment research report No. 728]

2010

Ryan, A. L. Analysis of the Massachusetts Adult Proficiency test for reading item banks and their representativeness of the new reading standards. [Center for Educational Assessment research report No. 733]
Zenisky, A. L., Lee, M. K., Cook, R. R., & Ryan, A. L. A review of MAPT practice tests. [Center for Educational Assessment research report No. 735]
Center for Educational Assessment and Adult and Community Learning Services Office. Massachusetts Adult Proficiency Tests (MAPT) for Mathematics and Numeracy: Understanding and Accessing the MAPT Score Reports. [Center for Educational Assessment research report No. 736]
Center for Educational Assessment, University of Massachusetts Amherst, & Adult and Community Learning Services Office, Massachusetts Department of Elementary and Secondary Education. Understanding and accessing the MAPT for Reading score reports. [Center for Educational Assessment research report No. 774]
Ryan, A., Sireci, S. G., Peters, E., Almanzar, J., Crevison, E., Haberstroh, S., Kayser, K., & Schwerdtfeger, J. Revisions to the specifications for the MAPT for Reading. [Center for Educational Assessment research report No. 778]

2011

Crotts, K., Sireci, S. G., & Zenisky, A. Evaluating content validity in a multistage adaptive test. [Center for Educational Assessment research report No. 780]
Colvin, K. F., Sireci, S. G., & Keller, L. A. Investigation of item parameter drift in a computerized multistage adaptive test. [Center for Educational Assessment research report No. 783]
Copella, J., & Sireci, S. G. Interpreting non-uniform DIF. [Center for Educational Assessment research report No. 785]
Xueming, L., & Sireci, S.G. Analyzing content validity ratings using multidimensional scaling. [Center for Educational Assessment research report No. 800]

2012

Zenisky, A. L., & Sireci, S. G. MAPT Item Bank Status Report: First Quarter FY2012. [Center for Educational Assessment research report No. 801]
Crotts, K., Zenisky, A. L., & Sireci, S. G. Estimating measurement precision in reduced-length multistage-adaptive testing. [Center for Educational Assessment research report No. 813]
Wang, X., & Sireci, S. G. Investigating the relationship between item response time and cognitive level. [Center for Educational Assessment research report No. 824]
Faulkner-Bond, M., & Sireci, S. G. Testing time and large score declines on the Massachusetts Adult Proficiency Tests for Mathematics. [Center for Educational Assessment research report No. 834]

2013

Wang, X., & Sireci, S. G. Evaluating the cognitive levels measured by test items using item response time. [Center for Educational Assessment research report No. 842]
Bahry, L., Lee, M. K., & Zenisky, A. L. Evaluating score reporting options on the MAPT practice tests: A simulation study to assess score ranges across levels. [Center for Educational Assessment research report No. 848]

2014

Zenisky, A. L., Sireci, S. G., Almanzar, J., Curtis, M. B., & Marcotte, A. Developing specifications for the Massachusetts Adult Proficiency Test for Reading – College and Career Readiness. [Center for Educational Assessment research report No. 876]
Zenisky, A. L., & Sireci, S. G. Developing specifications for the Massachusetts Adult Proficiency Test for Mathematics – College and Career Readiness. [Center for Educational Assessment research report No. 877]
Sireci, S. G., Zenisky, A. L., Marcotte, A., Diao, H., Almanzar, J., Curtis, M. B., Jungbluth, J., Teller, L., & Giordano, M. Test specifications for the Massachusetts Adult Proficiency Test for Reading – College and Career Readiness. [Center for Educational Assessment research report No. 886]
Zenisky, A.L., Sireci, S. G., Diao, H., Goodridge, B., Kell, R., Lyon, S., Martone, A., McSweeney, H., Noonan, M., Schwerdtfeger, J. Test specifications for the Massachusetts Adult Proficiency Test for Mathematics – College and Career Readiness. [Center for Educational Assessment research report No. 889]

2015

Marland, J., Sireci, S. G., Zenisky, A.L., & Pham, D. What can item response times tell us about differential item functioning for English learners? [Center for Educational Assessment research report No. 902]

2016

Sireci, S. G., Zenisky, A. L., Marland, J., Diao, H., Curry, D., Goodridge, B., Kell, V., Lyon, S., Martone, A., McSweeney, H., Noonan, M., Mechem, T., Schwerdtfeger, J., & Varzan-Parker, D. Revised test specifications for the Massachusetts Adult Proficiency Test for Mathematics – College and Career Readiness. [Center for Educational Assessment research report No. 913]
Marland, J., A. Zenisky, Sireci, S., Pham, D., & Boyer, M. Identifying college and career readiness standards for adult education that could be assessed using technologically-enhanced items. [Center for Educational Assessment research report No. 920]
Banda, E., Fan, F., Park, Y., & Zenisky, A. L. Considering measurement quality and test length reduction in the context of linear and multistage adaptive testing. [Center for Educational Assessment research report No. 926]
Zenisky, A. L., Marland, J., & Pham, D. Technology-enhanced items for Adult Basic Education: Exploratory item development. [Center for Educational Assessment research report No. 934]

2017

Casas, M., Hong, S., & Sireci, S. G. The stability of item statistics across test administration platforms. [Center for Educational Assessment research report No. 951]
Zenisky, A. L., Plant, A., Sireci, S. G., Park, Y., Banda, E. G., Padellaro, F., & Garcia, A. Evaluating the content validity of the MAPT-CCR for Math. [Center for Educational Assessment research report No. 956]
Zenisky, A. L., Pfrommer, P., Sireci, S. G., Park, Y., Banda, E. G., Padellaro, F., & Garcia, A. Evaluating the content validity of the MAPT-CCR for Reading. [Center for Educational Assessment research report No. 957]
Garcia, A. & Zenisky, A. Technology Enhanced Items Pilot Report. [Center for Educational Assessment research report No. 958]

2018

Garcia, A. A., & Zenisky, A. L. Massachusetts Adult Proficiency Tests (MAPT) for Mathematics – Understanding and Accessing the MAPT Score Reports Version 2. [Center for Educational Assessment research report No. 960]
Garcia, A. A., & Zenisky, A. L. Massachusetts Adult Proficiency Tests (MAPT) for Reading – Understanding and Accessing the MAPT Score Reports Version 2. [Center for Educational Assessment research report No. 961]
Sireci, S. G., Lim, H., Rodriguez, G., Zenisky, A. L., & Banda, E. Evaluating criteria for validity evidence based on test content. [Center for Educational Assessment research report No. 962]
Zenisky, A., McGann, C., Lonberg-Lew, S., & Braaten, M. Update of the MAPT-CCR for Mathematics – Calculator and Formula Page. [Center for Educational Assessment research report No. 967]
Zenisky, A. L., Almanzar, J., Fernandez-Buehrens, A., and Viscovich, M. Spring 2018 Update of the MAPT for Reading – College and Career Readiness Test Specifications. [Center for Educational Assessment research report No. 968]
Botha, S. M., Banda, E., & Sireci, S.G. Evaluating Cognitive Skills used by Adult Learners on a Mathematics Test. [Center for Educational Assessment research report No. 969]
Botha, S. M. Examining Response Time Data for the Massachusetts Adult Proficiency Test. [Center for Educational Assessment research report No. 970]
Botha, S. M. Examinee Test Taking Effort on an Adult Proficiency Test. [Center for Educational Assessment research report No. 971]
Lee, M. & Sireci, S. Gauging Students’ Progress on a Multistage-Adaptive Test. [Center for Educational Assessment research report No. 972]
Zenisky, A. L., Sireci, S. G., Lewis, J., Lim, H., O’Donnell, F., Wells, C. S., Padellaro, F., Jung, H. J., Banda, E., Pham, D., Hong, S. E., Park, Y., Botha, S., Lee, M., & Garcia, A. Massachusetts Adult Proficiency Tests for College and Career Readiness: Technical Manual. [Center for Educational Assessment research report No. 974]

2019

Lewis, J., Lim, H., Padellaro, F., & Sireci, S. G. (2019, February). Setting multiple standards on a vertically scaled multistage-adaptive test. [Center for Educational Assessment research report No. 979]