Curriculum Vitae for Russell Almond

Education

1990 Ph.D. in Statistics, Harvard University.
1986 A.M. in Statistics, Harvard University.
1983 B.S. with honors in Mathematics, California Institute of Technology.

Work Experience

Statistical and Computer Science Research

2010-Present: Associate Professor, Department of Educational Psychology and Learning System, College of Education, Florida State University, Tallahassee, FL, 32306.
1999-2010: Senior Research Scientist, Educational Testing Service, Psychometric Development and Resources Group, Princeton, NJ 08541.
1996-1999: Research Scientist, Educational Testing Service, Research Statistics Group.
1995-1996: Research Associate, RRA, Inc. Developed statistical algorithms for Los Alamos National Labs.
1992-1995: Research Scientist, StatSci division of MathSoft, Inc. (now Insightful) 1700 Westlake Ave, N, Suit 500, Seattle, WA, 98109.
1990-1991: Acting (Visiting) Assistant Professor, University of Washington, Department of Statistics.
1987-1989: Research Assistant to Professor Arthur P. Dempster, Harvard U. Dept. of Statistics.
1984-1987: Research Assistant to Professor Peter J. Huber, Harvard U. Dept. of Statistics.
1985-1986: Statistical Consultant for U. S. Windpower, Burlington, MA.

1979-1982

Student Summer Intern at Honeywell, Process Control Division, Ft. Washington, PA. A series of four summer jobs which were the result of a High School science award. Each summer was spent with a different engineering group:

Teaching

2005--2010: Volunteer Mentor with MentorPower, Inc. and Science Mentors 1-to-1. Mentored a local high school student working on a science or engineering project.
2002, 2004, 2006, 2007, 2008, 2009, 2010, 2011, 2012, 2013, 2014: NCME Tutorial: Bayesian Networks in Educational Assessment. Full day tutorial presented jointly with R. Mislevy, D. M. Williamson, and D. Yan.
Fall, 1996: Visiting Lecturer, Department of Statistics, Wharton School of Business, University of Pennsylvania.
1990-1992: Acting Assistant Professor, University of Washington, Department of Statistics.
1983-1984: Teaching Fellow under Professors Arthur Dempster and Willis Davis, Harvard U. Dept. of Statistics.

Awards

2006, ETS Presidential recognition for volunteer work for efforts with Mentor Power, Inc.
2005, ETS Team award for participation in ICT (Information Communcations Technology) Literacy Assessment development team.
2003, ETS Bright Idea Award.

Almond, Steinberg and Mislevy[2002]

2000, NCME (with Robert J. Mislevy and Linda S. Steinberg) National Council on Measurement in Education Award for Outstanding Scientific or Technical Contribution to Educational Measurement.

Mislevy, Steinberg and Almond [2003]

1998, ETS (with Robert J. Mislevy and Linda S. Steinberg) New Product Development Award for Most Outstanding Breakthrough.

Publications

Books

Russell G. Almond, Robert J. Mislevy, Linda S. Steinberg, and Duanli Yan. Bayesian Networks in Educational Assessment. Springer, In Preparation. with contributions from D. M. Williamson. (In press, to appear in 2014).
Russell G. Almond. Graphical Belief Modeling. Chapman and Hall, 1995.

Papers in Journals

R. G. Almond. Using automated essay scores as an anchor when equating constructed response writing tests. International Journal of Testing, 14(1):73–91, 2014. (doi:10.1080/15305058.2013.816309)
R. G. Almond, Y. J. Kim, G. Velasquez, and V. J. Shute. How task features impact evidence from assessments embedded in simulations and games. Measurement: Interdisciplinary Research and Perspectives, 12(1–2):1–33, 2014. with Discussion. (doi:10.1080/15366367.2014.910060)
Russell G. Almond. `I can name that Bayesian network in two matrixes'. International Journal of Approximate Reasoning, 51:167–178, 2010. (doi:10.1016/j.ijar.2009.04.005)
Russell G. Almond, Joris Mulder, Lisa A. Hemat, and Duanli Yan. Bayesian network models for local dependence among observable outcome variables. Journal of Educational and Behavioral Statistics, 34(4):491–521, 2009. (doi:10.3102/1076998609332751)
Russell G. Almond, Valerie J. Shute, Jody S. Underwood, and Juan-Diego Zapata-Rivera. Bayesian networks: A teacher's view. International Journal of Approximate Reasoning, 50:450–460, 2009. (doi:10.1016/j.ijar.2008.04.011)
Linda van der Gaag and Russell Almond. Preface to special issue on Bayesian applications. International Journal of Approximate Reasoning, 50:415, 2009. (doi:10.1016/j.ijar.2008.06.001)
R.G. Almond, D. Yan, and L.A. Hemat. Parameter recovery studies with a diagnostic Bayesian network model. Behaviormetrika, 35(2):159–185, 2008.
Valerie J. Shute, Eric G. Hansen, and Russell G. Almond. You can't fatten a hog by weighing it - or can you? Evaluating an assessment for learning system called ACED. International Journal of Artificial Intelligence in Education, 18(4):289–316, 2008.
Russell G. Almond. Cognitive modeling to represent growth (learning) using Markov decision processes. Technology, Instruction, Cognition and Learning (TICL), 5:313–324, 2007.
Russell G. Almond, Louis V. DiBello, Brad Moulder, and Juan-Diego Zapata-Rivera. Modeling diagnostic assessment with Bayesian networks. Journal of Educational Measurement, 44(4):341–359, 2007.
Sandip Sinharay and Russell G. Almond. Assessing fit of cognitively diagnostic models—a case study. Educational and Psychological Measurement, 67(2):239–257, 2007.
David M. Williamson, Robert J. Mislevy, and Russell G. Almond. Evidence-centered design for certification and licensure. CLEAR Exam Review, 14:14–18, 2004.
Robert J. Mislevy, Linda S. Steinberg, and Russell G. Almond. On the structure of educational assessment (with discussion). Measurement: Interdisciplinary Research and Perspective, 1(1):3–62, 2003.
Russell G. Almond, Linda S. Steinberg, and Robert J. Mislevy. Enhancing the design and delivery of assessment systems: A four-process architecture. Journal of Technology, Learning, and Assessment, 1:(online), 2002.
Robert J. Mislevy, Russell G. Almond, and Linda S. Steinberg. Design and analysis in a task-based language assessment. Language Testing, 19(4):477–496, 2002.
R.G. Almond, C. Lewis, J.W. Tukey, and D. Yan. Displays for comparing a given state to many others. The American Statistician, 54:89–93, 2000.
Russell G. Almond and Robert J. Mislevy. Graphical models and computerized adaptive testing. Applied Psychological Measurement, 23:223–238, 1999.
R.J. Mislevy, L.S. Steinberg, F.J. Breyer, R.G. Almond, and L. Johnson. A cognitive task analysis, with implications for designing a simulation-based assessment system. Computers and Human Behavior, 15:29–42, 1999.
D. Madigan, K. Mosurski, and R.G. Almond. Graphical explanation in belief networks. Journal of Computational Graphics and Statistics, 6(2):160–181, 1997. (doi:10.1080/10618600.1997.10474735)
H.F. Martz and R.G. Almond. Using higher-level failure data in fault tree quantification. Reliability Engineering and Safety Systems, 56:29–42, 1997.
R.G. Almond. Fuzzy logic: Better science or better engineering. Technometrics, 37(147):267–270, 1995. comment to M. Laviolette, J.W. Seaman, Jr., J.D. Barrett and W.H. Woodall, A probabilistic and statistical view of fuzzy methods.
Russell G. Almond. Building blocks for graphical belief models. Journal of Applied Statistics, 18:63–76, 1991.

Papers in Edited Collections

R. Almond. A comparison of two mcmc algorithms for hierarchical mixture models. In K. B. Laskey, J. H. R. Jones, and R. G. Almond, editors, Bayesian Modelling Application Workshop at the Uncertainty in Artificial Intelligence (UAI) Conference, 2014.
R. G. Almond, Ilya Goldin, Yuhua Guo, and Nan Wang. Vertical and stationary scales for progress maps. In J. Stamper, Z. Pardoz, M. Mavrikis, and B. M. McLaren, editors, Proceedings of the 7th International Conference on Educational Data Mining, pages 169–176, 2014.
R. G. Almond and Ole Mengshoel, editors. Proceedings of the 2013 UAI Application Workshops: Big Data meet Complex Models and Models for Spatial, Temporal and Network Data (UAI2013AW), number 1024 in CEUR Workshop Proceedings, Aachen, 2013.
R. G. Almond, Yoon Jeon Kim, V. J. Shute, and Matthew Ventura. Debugging the evidence chain. In Almond and Mengshoel [Almond and Mengshoel, 2013], pages 1–10.
R.G. Almond, U. Tokac, and S. Al Otaiba. Using POMDPs to forecast kindergarten students reading comprehension. In J. M. Agosta, A. Nicholson, and M. J. Flores, editors, The 9th Bayesian Modelling Application Workshop at UAI 2012, Catalina Island, CA, August 2012.
Russell G. Almond. Graphical models. In Penelope Peterson, Eva Baker, and Barry McGaw, editors, The International Encyclopedia of Education, pages 197–202. Elsevier, 3rd edition, 2010.
Russell G. Almond. Using evidence centered design to think about assessments. In Valerie J. Shute and Betsy J. Becker, editors, Innovative Assessment for the 21st Century: Supporting Educational Needs, pages 75–100. Springer, 2010. (doi:10.1007/978-1-4419-6530-1_6)
V. J. Shute, E. G. Hansen, and R. G. Almond. Evaluating aced: The impact of feedback and adaptivity on learning. In R. Luckin, K. R. Koedinger, and J. Greer, editors, Intelligence in Education: Building Technology Rich Learning Contexts that Work, chapter 8, pages 230–237. IOS Press, 2007.
Robert J. Mislevy, Linda S. Steinberg, Russell G. Almond, and Janice F. Lukas. Concepts, terminology and basic models of evidence-centered design. In David M. Williamson, Robert J. Mislevy, and Isaac I. Bejar, editors, Automated Scoring of Complex Tasks in Computer-Based Testing, pages 15–47. Lawrence Erlbaum Associates, 2006.
David M. Williamson, Russell G. Almond, Robert J. Mislevy, and Roy Levy. An application of Bayesian networks in automated scoring of computerized simulation tasks. In David M. Williamson, Robert J. Mislevy, and Isaac I. Bejar, editors, Automated Scoring of Complex Tasks in Computer-Based Testing, pages 201–257. Lawrence Erlbaum Associates, 2006.
L.T. Frase, M. Chudorow, R.G. Almond, J. Burstein, K. Kukich, R.J. Mislevy, L.S. Steinberg, and K. Singley. Technology and assessment. In H.F. O'Neil and R. Perez, editors, Technology applications in assessment: A learning view, pages 213–244. Erlbaum, 2003.
R. J. Mislevy, L.S. Steinberg, R.G. Almond, G. Haertel, and W. Penuel. Leverage points for improving educational assessment. In B. Means and G. Haertel, editors, Evaluating the Effects of Technology in Education, pages 149–180. Earlbaum, 2003.
Russell G. Almond, Linda S. Steinberg, and Robert J. Mislevy. A framework for reusing assessment components. In H. Yanai, Okada. A., K. Shigemasu, Y. Kano, and J. J. Meulman, editors, New Developments in Psychometrics, pages 281–288. Springer, 2002.
Robert J. Mislevy, Linda S. Steinberg, and Russell G. Almond. On the roles of task model variables in assessment design. In S. Irvine and P. Kyllonen, editors, Generating items for cognitive tests: Theory and practice, pages 97–128. Erlbaum, 2002.
R.G. Almond, L. Dibello, F. Jenkins, R.J. Mislevy, D. Senturk, L.S. Steinberg, and D. Yan. Models for conditional probability tables in educational assessment. In T. Jaakkola and T. Richardson, editors, Artificial Intelligence and Statistics 2001, pages 137–143. Morgan Kaufmann, 2001.
David M. Williamson, Robert J. Mislevy, and Russell G. Almond. Model criticism of Bayesian networks with latent variables. In C. Boutilier and M. Goldszmidt, editors, Uncertainty in Artificial Intelligence 16, pages 634–643. Morgan Kaufmann, 2000.
Russell G. Almond. Undoing statistical advice. In D.J. Hand, J.N. Kok, and M.R Berthold, editors, Advances in Intelligence Data Analysis, pages 357–368. Springer, 1999.
R.G. Almond, E. Herskovits, R.J. Mislevy, and L.S. Steinberg. Transfer of information between system and evidence models. In D. Heckerman and J. Whittaker, editors, Artificial Intelligence and Statistics 99, pages 181–186, 1999.
Robert J. Mislevy, Russell G. Almond, Duanli Yan, and Linda S. Steinberg. Bayes nets in educational assessment: Where the numbers come from. In K. B. Laskey and H. Prade, editors, Uncertainty in Artificial Intelligence '99, pages 437–446. Morgan-Kaufmann, 1999.
D. Madigan and R.G. Almond. Test selection strategies for belief networks. In D. Fisher and H.J. Lenz, editors, Learning from Data: AI and Statistics V, pages 89–98. Springer-Verlag, 1995.
R.G. Almond, J.M. Bradshaw, and D. Madigan. Reuse and sharing of graphical belief network components. In P. Cheeseman and W. Oldford, editors, Selecting Models from Data: Artificial Intelligence and Statistics IV, pages 113–122. Springer-Verlag, 1994.
D. Madigan, A. E. Raftery, J. C. York, J. M. Bradshaw, and R. G. Almond. Strategies for graphical model selection. In P. Cheeseman and W. Oldford, editors, Selecting Models from Data: Artificial Intelligence and Statistics IV, pages 91–100. Springer-Verlag, 1994.
D. Madigan, J.C. York, J.M. Bradshaw, and R.G. Almond. Bayesian graphical models for predicting errors in databaes. In P. Cheeseman and W. Oldford, editors, Selecting Models from Data: Artificial Intelligence and Statistics IV, pages 123–132. Springer-Verlag, 1994.
Russell G. Almond. Lack of information based control in expert systems. In D.J. Hand, editor, Artificial Intelligence Frontiers in Statistics: AI and Statistics III, pages 82–89. Chapman and Hall, 1993.
J.M. Bradshaw, C.R. Chapman, K.M. Sullivan, R.G. Almond, D. Madigan, D. Zarley, J. Gavrin, J. Nims, and N. Bush. Ks-3000: an application of DDUCKS to bonemarrow transplant patient support. In Proceedings of the Sixth Annual Florida AI Research Symposium (FLAIRS '93), pages 78–83, 1993.
R. G. Almond. Breaking dependence in graphical belief models. In Connie Page and Raul LaPage, editors, Computing Science and Statistics: Proceedings of the 22nd Symposium on the Interface, pages 296–299. Springer-Verlag, 1990.
R. G. Almond. Fusion and propagation in graphical belief models. In Edward J. Wegman, Donald T. Gantz, and John J. Miller, editors, Computing Science and Statistics: Proceedings of the 20th Symposium on the Interface., pages 365–370. American Statistical Association, 1988.

Presentations

Russell Almond. Weighing educational evidence. In 76th Annual Meeting of the National Council on Measurement in Education (NCME), Philadelphia, PA, 2014.
Russell Almond and Tingxuan Li. Hierarchical mixture models for pause events during essay writing. In 76th Annual Meeting of the National Council on Measurement in Education (NCME), Philadelphia, PA, 2014.
Haiyan Wu and Russell Almond. A comparison of general diagnostic models and bayesian networks. In 76th Annual Meeting of the National Council on Measurement in Education (NCME), Philadelphia, PA, 2014.
Y. J. Kim, M. Cui, and R. G. Almond. Empirical comparison of Bayesian networks and structural equation models in the context of educational assessment. Poster presented at the Annual Meeting of the American Educational Research Association (AERA), April 2014.
Yoon Jeon Kim, Russell G. Almond, Valerie J. Shute, and Mathew Ventura. Constructing Bayesian networks for a stealth assessment of qualitative physics. Paper presented at the 76th Annual Meeting of the National Council on Measurement in Education (NCME), April 2014.
Tingxuan Li and R. G. Almond. A bayesian hierarchical mixture approach to model timing data with application to writing assessment. Paper presented at the Annual Meeting of the Florida Educational Research Association (FERA)., Nov 2013.
U. Tokac and R. G. Almond. Early prevention of reading difficulties by using formative assessment in partially observed Markov decision process. Poster preseted at Annual Meeting of the American Educational Research Association (AERA), April 2013.
H. Wu and R. G. Almond. The comparison of the general diagnostic model (GDM) and Bayesian networks using a middle school mathematics test. Poster preseted at Annual Meeting of the American Educational Research Association (AERA), April 2013.
R. G. Almond, Y. J. Kim, G. Velasquez, and V. J. Shute. How task features impact evidence from assessments embedded in simulations and games. Paper presented at the International Meeting of the Psychometric Society (IMPS), July 2012.
R. G. Almond. Democratize ECD? Discussion presented at the Games and Learning Society conference, gls 8.0, June 2012.
Y. J. Kim, M. Ventura, V. Shute, and R. G. Almond. Newton's playground: How to use evidence centered design (ecd) to develop game-based assessment. Workshop presented at the Games and Learning Society conference, gls 8.0, June 2012.
M. Ventura, Y. J. Kim, R.G. Almond, and L. Wang. Using crayon physics deluxe. Workshop Presented at Second FCR-STEM Conference, Destin, Florida, Dec. 2–4 2011.
R. G. Almond and V. J. Shute. ACED: An example of using bayesian networks for cognitive diagnosis. Presented at the Annual Meeting of the Association for Psychological Science (APS), May 2011.
R. G. Almond. Measuring change in mental models. Discussion presented at the Annual Meeting of the American Educational Research Association (AERA), April 2011.
R.G. Almond. Challenges in mcmc, em and bayesian psychometrics. Discussion presented at the 2011 Annual Meeting of the National Committee on Measurement in Education (NCME), New Orleans, LA, April 2011.
R.G. Almond. Utilities and quasi-utilities for classification. Presented at the annual meeting of the National Committee on Measurement in Education (NCME), New Orleans, LA., April 2011.
R. G. Almond, P. Deane, T. H. Quinlan, and Y. Attali. Using timing logs to diagnose problems in writing performance. Presented at the Annual Meeting of the American Educational Research Association (AERA), April 2011.
Russell G. Almond and Anastasiya Lipnevich. Value of evidence: A decision theoretic approach to validity for diagnostic assessment. Paper presented at the 2009 Annual Meeting of the American Educational Research Association (AERA), April 2009.
Russell G. Almond and Valerie J. Shute. Calibration of Bayesian network-based diagnostic assessment. Paper presented at the 2009 Annual Meeting of the American Educational Research Association (AERA), April 2009.
Russell G. Almond. Evidence-centered design as a tool for thinking about assessment. Keynote presentation at Assessment for the 21^st Century: Insight. College of Education, Florida State Univeristy, October 30 2008.
Russell G. Almond. Modeling diagnostic assessments with Bayesian networks. Invited Paper presented at the 2008 Annual Meeting of the Society for Mathematical Psychology, July 2008.
Edith Aurora Graf, Karen Harris, Elizabeth Marquez, and Russell Almond. A cognitively based assessment system for mathematics competency. Presented at the Annual Meeting of the American Educational Research Association (AERA), March 2008.
Russell G. Almond. `I can name that Bayesian network in two matrixes'. In K. B. Laskey, S. M. Mahoney, and J. A. Goldsmith, editors, Proceedings of the 5th UAI Bayesian Modelling Applications Workshop, volume 268, page (online). CEUR Workshop Proceedings, 2007. Held in conjunction with the 23rd Conference on Uncertainty in Artificial Intelligence (UAI-2007).
Russell G. Almond, Robert J. Mislevy, and Duanli Yan. Using anchor sets to identify scale and location of latent variables. Paper presented at Annual meeting of the National Council on Measurement in Education (NCME), 2007.
V. J. Shute, E. G. Hansen, and R. G. Almond. Evaluation of ACED: The impact of feedback and adaptivity on learning. In R. Luckin, K. Koedinger, and J. Greer, editors, Artificial Intelligence in education—Building technology rich learning contexts that work, pages 230–237, 2007.
Valerie J. Shute, E. G. Hansen, and R.G. Almond. Towards accessible test delivery systems: A small-scale evaluation of a prototype system for improving the accessibility of mathematics tests by individuals with visual disabilities. Paper Presented at Annual meeting of the National Council on Measurement in Education (NCME), 2007.
Russell G. Almond. Cognitive modeling to represent growth (learning) using Markov decision processes. In Annual meeting of the American Educational Research Association (AERA), 2006.
Russell G. Almond, Valerie J. Shute, Jody S. Underwood, and Juan-Diego Zapata-Rivera. Bayesian networks: A teacher's view. In Proceedings of the 4th Bayesian Modelling Applications Workshop, 2006. Held in conjunction with the 22nd Conference on Uncertainty in Artificial Intelligence (UAI-2006).
Feifei Ye, Russell Almond, and Robert Mislevy. Diagnostic assessment of student learning of patterns in 8th grade math classes: an evidence-centered design approach. Paper presented at Annual meeting of the National Council on Measurement in Education (NCME), 2006.
Russell G. Almond. XML for data analysts. Presentation given as part of the Tukey Seminar on Data Analysis at ETS., December 2006.
Duanli Yan, Russell G. Almond, Robert J. Mislevy, and David M. Williamson. Bayesian network applications. Presentation at National Tsing-Huan University, November 2006. Taipei, Taiwan.
Duanli Yan, Russell G. Almond, Robert J. Mislevy, and David M. Williamson. Bayesian network applications. Presentation at Institute of Information Science, November 2006. Academica Sinica.
Russell G. Almond. Building self-efficacy: How mentorpower works. Talk given as part of 2006 mentor training session., October 2006.
Russell G. Almond and Joris Mulder. Models for local dependence among observable outcome variables. In Third Annual Bayesian Application Workshop at the 2005 Uncertainty in Artificial Intelligence Application Workshop, 2005.
Duanli Yan and Russell Almond. Using ROC curves to improve evidence for diagnostic scoring. In Third Annual Bayesian Application Workshop at the 2005 Uncertainty in Artificial Intelligence Application Workshop, 2005.
R.G. Almond, L.A. Hemat, J.D. Zapata-Rivera, and D.M. Williamson. Procrustean method for reconciling expert opinion. In 2nd Bayesian Application Workshop at Uncertainty in Artificial Intelligence, 2004.
I. R. Katz, D. M. Williamson, H. L. Nadelman, I. Kirsch, R. G. Almond, P. L. Cooper, M. L. Redman, and D. Zapata. Assessing information and communications technology literacy for higher education. In International Association for Educational Assessment, 2004.
F. Ye, R.G. Almond, R.J. Mislevy, and D. Yan. Sensitivity to prior distributions in calibration of a Bayesian network. In Annual meeting of the National Council on Measurement in Education, 2004.
Russell Almond, David Williamson, and Duanli Yan. Testing tests: Quality control for assessment design. In 1st Bayesian Application Workshop at Uncertainty in Artificial Intelligence, 2003.
R. G. Almond. Question and test interoperability in the new millenium. In International Meeting of the Psychometric Society, 2001.
C. Smythe and R.G. Almond. The QTI framework for sharing assessment data and results. In International Meeting of the Psychometric Society, 2001.
R.G. Almond, L.S. Steinberg, and R.J. Mislevy. The four process assessment delivery architecture. In Cognition and Assessment: Theory to Practice. University of Maryland, August 2001.
F.J. Breyer, R.J. Mislevy, L.S. Steinberg, and R.G. Almond. Designing technology-based assessments: It's the evidence for the inferences that are important. In Annual Convention of the Society for Industrial Organizational Psychology, 1999.
R.G. Almond, R.J. Miselvy, and L.S. Steinberg. A multivariate frameork for educational testing. In Taipei Interanational Statistics Symposium, 1998.
R.J. Mislevy, L.S. Steinberg, and R. G. Almond. Evidence-centered assessment design. In Annual Conference of the National Center for Research on Evaluation, Standards, Student Testing (CRESST), 1998.
R.J. Mislevy, R.G. Almond, and L.S. Steinberg. Task design, student modeling, and evidentiary reasoning in complex educational assessments. In Section on Bayesian Statistical Science at the Annual Meeting of the American Statistical Association, 1997.
Russell G. Almond. Intelligent support of secondary data analysis. In 6th International Workshop on AI and Statistics,, 1996.

Selected Technical Reports

R. G. Almond. Discretized partial credit models for bayesian network conditional probability table. Supmitted to Applied Psychological Measurement., 2013.
Duanli Yan, Russell Almond, and Lisa Hemat. Bayesian network model for the ICT literacy assessment. Research Report Pending, Educational Testing Service, 2005. Under Review.

Note: The ETS Research Report and Research Memorandum series are internally refereed.

Russell G. Almond and Sandip Sinharay. What can repeated cross-sectional studies tell us about student growth?. Research Report RR-12-17, Educational Testing Service, 2012.
Russell G. Almond, Paul Deane, Thomas Quinlan, Michael Wagner, and Tetyana Sydorenko. A preliminary analysis of keystroke log data from a timed writing task. Research Report RR-12-23, Educational Testing Service, 2012.
R. G. Almond. Estimating parameters of periodic assessment models. Research Report RM-11-06, Educational Testing Service, 2011.
Russell G. Almond. An illustration of the use of Markov decision processes to represent student growth (learning). Research Report RR-07-40, ETS, 2007.
V. J. Shute, E. G. Hansen, and R. G. Almond. An assessment for learning system called ACED: The impact of feedback and adaptivity on learning. Research Report RR-07-26, ETS, 2007.
Russell G. Almond, Joris Mulder, Lisa A. Hemat, and Duanli Yan. Models for local dependence among observable outcome variables. ETS Research Report RR-06-36, Educational Testing Service, 2006.
Russell G. Almond, Duanli Yan, Alexander Matukhin, and Denise Chang. StatShop testing. ETS RM 06-04, Educational Testing Service, 2006.
R.J. Mislevy, R.G. Almond, and J. Lukas. A brief introduction to evidence-centered design. CSE Technical Report 632, The National Center for Research on Evaluation, Standards, Student Testing (CRESST), 2004. Also ETS Research Report RR-03-16.
Sandip Sinharay, Russell G. Almond, and Duanli Yan. Assessing fit of models with discrete proficiency variables in educational assessment. Research Report RR-04-07, Educational Testing Service, 2004.
Duanli Yan, Russell G. Almond, and Robert J. Mislevy. Comparison of two models for cognitive diagnosis. Research Report RR-04-02, Educational Testing Service, 2004.
L.S. Steinberg, R.G. Almond, A.B. Baird, C. Cahallan, H. Chernick, L.V. Dibello, A.C.H. Kindfield, R.J. Mislevy, D. Senturk, and D. Yan. Introduction to the Biomass project: An illustration of evidence-centered assessment design and delivery capability. CSE Report 609, National Center for Research on Evaluation, Standards, and Student Testing (CRESST)., 2003.
Duanli Yan, Robert J. Mislevy, and Russell G. Almond. Design and analysis in a cognitive assessment. Research Report RR-03-32, Educational Testing Service, 2003.
Russell G Almond. Using evidence models to aggregate information. White Paper developed for ONR call for suggestions about the future of assessment., 2002.
Robert J. Mislevy, Russell G. Almond, Lou DiBello, Frank Jenkins, Linda S. Steinberg, Duanli Yan, and Deniz Senturk. Modeling conditional probabilities in complex educational assessments. CSE Technical Report 580, The National Center for Research on Evaluation, Standards, Student Testing (CRESST), 2002. Numerical example for testing Ergo.
R.J. Mislevy, L.S. Steinberg, F.J. Breyer, R.G. Almond, and L. Johnson. Making sense of data from complex assessments. CSE Technical Report 538, The National Center for Research on Evaluation, Standards, Student Testing (CRESST), 2001.
R.J. Mislevy, R.G. Almond, and L.S. Steinberg. A note on knowledge-based model construction in educational assessment. CSE Technical Report 480, The National Center for Research on Evaluation, Standards, Student Testing (CRESST), 1998. Numerical example for testing Ergo.
R.G. Almond. Hypergraph grammars for knowledge based model construction. StatSci Research Report 23, 1995.
Russell G. Almond. Capturing reliability knowledge in Graphical-Belief. StatSci Research Report 31. Presented in special NASA collection, 1995.
R. G. Almond and J. Schimert. Missing data models as meta-data. StatSci Research Report 29, 1995.
Russell G. Almond. Brushing histories to compare models. StatSci Research Report 17., 1994.
Russell G. Almond. Graphical-Belief: Phase II annual report. SBIR final report, 1994.
R.G. Almond, E. Arbogast, M.Y. Jaisimha, and S.F. Elston. Intelligent image browsing and feature extraction. StatSci Research Report 25., 1994.
Russell G. Almond and D. Madigan. Using Graphical-Belief to predict risk of coronary artery disease. StatSci Research Report 19., 1993.
Russell G. Almond. An approach to style in data analysis. Technical Report 225, University of Washington, Department of Statistics, 1992.
Russell G. Almond. Fiducial inference and belief functions. Technical Report 206, University of Washington, Department of Statistics, 1991.
R.G. Almond and C-T. A. Kong. Some heuristics for building an optimal tree of cliques from a graph or hypergraph. Research Report 329, University of Chicago, Department of Statistics, 1991. Finn Jensen dubbed the tree produced by this algorithm as the "Almond Tree.".

Films

R. Almond, P. Huber, P. Kempthorne, and L. Roseman. Exploratory multivariate analysis: The crabs data. Harvard University, 1987. 20 min. film.
R. Almond, P. Huber, E. Ramos, L. Roseman, and M. Thoma. Visual aspects of 3d data graphics: A movie. Siam Conference on Computers is Statistics, 1984. 10 min. film.

Computer Experience

Operating Systems UNIX (Solaris, Sun OS, MacOS X), MacOS, Apollo Aegis, VAX/VMS, Honeywell Multics
Languages Java, Lisp, CLOS, C/C++, Fortran, APL, Basic, Pascal, Prolog, Assembler (68000 and 8080), PHP, Perl, Postscript, TeX, XML
Statistics S/S-Plus/R, Lisp-Stat, ISP, GLIM, Minitab, IMSL, BUGS/JAGS/Stan
Techniques Object-oriented design and analysis, User interface and human factors design (GUI), Artificial Intelligence, Rule-based programming, Constraint-based programming, Graphical Modelling, Language Design, Machine Learning, Neural Networks, and Databases.

Software Systems Designed

RNetcia Binding of the Netica API (for building and manipulating Bayesian networks) in R.
CPTtools Suit of tools for building conditional probability tables for Bayesian networks in R.
Newton's Playground Game for assessing Creativity, Persistence and Physics. Responsible for Bayes net scoring engine design.
StatShop Suite of tools for statistical analaysis of Evidence Centered Design models, in particular Bayesian networks. Includes scoring engine (evidence accumulation process), calibrator (MCMC based) and data simulator. All input/output is XML based.
Asp Suite of tools written in R for accessing and manipulating StatShop data (both from intermediate databases and XML).
ACED (Adaptive Content with Evidence-based Diagnosis) A prototype systems for delivering customized diagnostic assessment. Responsible for task selction algorithm and Bayes net scoring engine (StatShop).
QTI Specification Active member of the IMS Global Consortium working group on Question and Test Interoperability. Key contributor to Version 1 XML specification development. http://www.imsglobal.org/question/
Evidence Accumulation Process An open architecture for supporting many possible scoring engines. Including number right and graphical model based scoring. Planned developments include discrete IRT and multivariate IRT models. Runs on Java 1.1 virtual machine (graphical model engine uses Win32 version of Ergo library).
Four Engine Delivery System A simple message passing architecture for implementing a modular assessment delivery system. The four processes do not need to be co-resident on the same computer and and both which processes are used and the message table can be customized for a particular architecture. Runs on Java 1.1 virtual machine.
Biomass Prototype Assessment Lead analyst/developer for a prototype web-delivered High School biology genetics assessment. Processes were implemented in Java, Visual Basic, IIS and Javascript. Includes a drag and drop library written in Java.
Portal Scoring Engine Graphical model based scoring system. Runs on Win32 (Windows NT/95/98).
NAEPVUE Prototype visual interface for analyzing NAEP data. Includes statistical advice and extensive data encyclopedia.
Definitions-Doc Software for extracting project documentation from XLISP-STAT projects.
Graphical-Belief Revised and extended version of Belief with many new capabilities and graphical user interface. Online walk through at: http://ralmond.net/gb/
ElToY Program for eliciting Bayesian conjugate prior distributions through constraint based dynamic graphics. Written in XLISP-STAT. Copies available via StatLib: http://lib.stat.cmu.edu/xlispstat/eltoy
Belief Program to manipulate graphical belief function models written in Common Lisp. Available via Carnegie Mellon Artificial Intelligence Repository: http://www.cs.cmu.edu/afs/cs/project/ai-repository/ai/areas/reasonng/probabl/belief/0.html

Documentation

Russell G. Almond and Lisa A. Hemat. ICT model repository. ETS Internal Website, 2005.
Lisa Hemat, Russell Almond, and Jan Lukas. StatShop Documentation. Educational Testing Service, Version 2.0 edition, December 2005. URL is internal to ETS.
R.G. Almond, A. Matukhin, L. Steinberg, S. Sinharay, D.M. Williamson, and D. Yan. A framework for calibrating evidence models. Unpublished StatShop documentation, 2002.
R.G. Almond, A. Matukhin, L. Steinberg, D.M. Williamson, and D Yan. A framework for evidence accumulation. Unpublished StatShop design documention, 2002.
Russell G. Almond. ElToY: Implementing Bayesian computation through constraints. StatSci Research Report 24, 1994.

Patents

Linda S. Steinberg, Robert J. Mislevy, and Russell G. Almond. Portal assessment design system for educational testing. U.S. Patent application, Pending. Attorney Docket No. 246400.0159, Wilmer, Culter and Pickering.
Valerie J. Shute, Eric G. Hansen, and Russell G. Almond. Method and system for desiging adaptive, diagnostic assessments. U.S. Patent #7,828,552, 2010.

Professional Activities

Program Chair Bayesian Modeling Application Workshop at Uncertainty in Artificial Intelligence conference, 2005 and 2013 (Co-chair in 2006, 2014).
Program Committee Uncertainty in Artificial Intelligence, 1999, 2000, 2003, 2004, 2010, 2011, 2012, 2013, 2014; Artificial Intelligence and Statistics, 1997, 1999, 2001.
Review Panel Member IES Review Panel on Early Childhood Education and Special Education, Institute for Educational Statistics, U.S. Department of Education. Regular panelist from 2009--2011.
Standards Bodies Working group member for IMS Consortium group on Question and Test Interoperability, 1999-2001.
Professional Memberships American Statistical Association, Association for Computing Machinery, American Educational Research Association, and National Council on Measurement in Education.

Community Service and Other Interests

2006--2007 Board of Directors of Mentor Power, Inc, a local non-profit, science-based, one-to-one mentor program that instpires, motivates, and empowers under served high school students to develop academic discipline, cirticial thinking and personal responsibility. Mentor Power reformed (with a very similar program and objectives) as Science Mentors 1-to-1.

2004--2010Volunteer mentor with Mentor Power, NJ and Science Mentors 1-to-1

Storytelling, Music (small recorder ensembles, bassoon, curtal, shawm, composition), History of Music, Fencing, Blacksmithing and Armor Making, Bird and Nature Watching, Writing (Science Fiction and Game Design), and Medieval and Islamic History, Chinese and Japanese languages.

Other personal inforamtion including pictures of my twin daughters can be found at: http://ralmond.net/

Russell Almond, <lastname> (at) acm.org

Last modified: Jul 6, 2014