This site uses cookies for learning about our traffic, we store no personal details. ACCEPT COOKIES DECLINE COOKIES What are cookies?
univerge site banner
Original Article | Open Access | Int. J. Mat. Math. Sci., 2024; 6(3), 78-84 | doi: 10.34104/ijmms.024.078084

Measuring Student Performance in Mathematics in the Modern World Course Using Blooms and Solo Taxonomies

Romell A. Ramos Mail Img ,
Miraflor C. Gutierrez Mail Img ,
Elizabeth Socorro P. Carang* Mail Img ,
Rochelle R. Caguete Mail Img

Abstract

The quality of learning could be determined by observing students performance through the use of SOLO (Structure of the Observed Learning Outcome) and Blooms taxonomies, which are a few of the educational frameworks that can be used to examine the level of students mathematical skills and performance. The descriptive method utilizing documentary analysis and testing methods was used as instruments involving 1239 students from the different programs, where the attainment levels were computed based on the index of mastery. The results showed that the majority of the learning outcomes in Blooms taxonomy are not well distributed since are mostly under application, analysis, synthesis, and evaluation levels only, while the SOLO thinking levels are also not well distributed where mostly targeting the multi-structural and the relational levels. Meanwhile, mapping the items in the major examinations showed that most of the items target comprehension, application, and analysis in Blooms taxonomy, while multi-structural and relational levels in the SOLO taxonomy. Furthermore, data revealed that the students are not able to attain the expected level of thinking using the assessment instrument since it cannot provide evidence of performance/attainment in the other thinking levels such as knowledge, synthesis, evaluation, uni-structural, and extended abstract. Overall, Blooms and Solo Taxonomies are crucial tools for evaluating how well students are doing in mathematics in the modern world course. It gives teachers a framework for creating tests and lessons aligned with specific objectives for learning and aids in a deeper comprehension of mathematical ideas.

INTRODUCTION

Traditionally, teachers have predominantly favored the content-based approach to teaching. However, the implementation of outcomes-based education (OBE) in higher education (HE) has shifted the focus towards course outcomes and learners specialization areas. The Philippine Commission on Higher Educations (CHED) Handbook on Typology, OBE, and Institu-tional Sustainability Assessment (ISA) (2014) empha-sizes the necessity for Filipino students to be globally competitive through high-quality education that equips them with essential competencies and attitudes. Consequently, the government initiated the transition from input-based to outcomes-based education in higher education in 2014, placing students at the forefront of educational planning. As educational reform progresses, theres also a push for standards-based reform in mathematics education, aiming to elevate academic standards for all students. A notable issue in Filipino mathematics education is the students tendency to perceive the subject as a collection of disconnected facts and procedures rather than a coherent system of ideas and operations reflecting real-world patterns and relationships. This underscores a global shift in the perception of mathematics.

Furthermore, various factors, including teaching and evaluation methods, have contributed to students limited success and performance in mathematics. Reports indicate high failure rates, poor understanding of mathematical concepts among students, and the adverse effects of exams (Conn, 2017). Additionally, researchers have observed a stigma surrounding mathematics, which fosters negative attitudes towards learning the subject. These negative perceptions persist in students minds and can lead to psycho-somatic reactions, indicating that the stigma is deeply ingrained (Corpuz & Saldanan, 2015). Consequently, students may develop a desire for math-related activities or discussions to conclude quickly, reflecting their aversion to the subject. On the contrary, students often lack opportunities to demonstrate their own understandings and outputs in mathematics courses, as assessment typically relies on conventional paper-and-pencil tests. These tests often present difficulties in a decontextualized manner, reinforcing the perception of unrelated concepts. Meeting the predetermined criteria is the sole focus for passing these tests, rather than understanding the underlying reasoning behind problem-solving methods. Consequently, students tend to mimic the problem-solving processes demonstrated by their teachers rather than engaging in critical thinking. In some cases, students may leave questions blank if they differ even slightly from what theyve encountered before, indicating a lack of adaptability and critical thinking skills. To address these issues, outcomes-based education (OBE) provides support for math educators to implement teaching strategies that emphasize not only how to teach but also what methods to use, what learning experiences to provide, and what assessment tools to employ to connect abstract concepts to real-life applications. The primary rationale for adopting OBE is to enhance learning outcomes, leading to initiatives such as CHED Memo-randum Order (CMO) No. 40 Series of 2012, which shifts recognition and accreditation standards in higher education institutions (HEIs) from an input-based to an outcomes-based approach.

Moreover, the Commission on Higher Education has revised the general education curriculum, significantly reducing the number of course units from 63 to 36, with Mathematics in the Modern World being one of the core courses (Valencia, 2015). This course empha-sizes the practical application of algebra in everyday scenarios encountered by students, aiming to cultivate an appreciation for mathematics across various professions and endeavors (DLSU, 2015). The over-arching goal of Mathematics in the Modern World is to provide students with problem-solving opportunities that demonstrate the relevance and utility of mathe-matics in diverse contexts. To enhance the teaching and learning experiences within the course, it is imperative to evaluate its impact on both students and teachers while aligning instructional practices with the intended course outcomes. OBE necessitates effective instruction and innovative instructional materials to ensure that students are achieving these outcomes. Furthermore, students proficiency in mathematics is essential for enhancing their performance in the subject and applying it in everyday life and future endeavors. Developing mathematical skills not only boosts confidence but also fosters the ability to interpret mathematical concepts, utilize technology, critically analyze issues, and solve problems effec-tively. Problem-solving, in particular, is a fundamental mathematical skill that holds significant importance. Therefore, its crucial to assess the extent to which students have mastered these skills. Educational frameworks such as the Structure of the Observed Learning Outcome (SOLO) Taxonomy and Blooms Taxonomy are valuable tools for evaluating students mathematical skills and performance. 

The SOLO Taxonomy provides a systematic and understandable framework for assessment, accessible to both teachers and students. It categorizes students skill levels into five hierarchical categories: pre-structural, uni-structural, multi-structural, relational, and extended abstract (Putri et al., 2017). This taxonomy not only aids in assessment but also high-lights cognitive diversity and students responses to different levels of thinking. Conversely, the updated version of Blooms Taxonomy emphasizes higher-order thinking skills such as analyzing, evaluating, and creating. It posits that lower-order thinking skills are foundational for higher-order thinking skills (Agarwal, 2019). Adhering to the Revised Blooms Taxonomy (RBT) levels when creating assessment materials promotes inclusivity and enhances students capacity for higher-order thinking in mathematics.

Originally designed for assessment purposes, these frameworks are invaluable for evaluating students readiness and performance. By observing students responses, educators can gauge the quality of learning. Recognizing the significance of these frameworks, researchers and mathematics educators have con-ducted studies using Blooms and SOLO Taxonomy to measure students performance in courses like Mathematics in the Modern World. Utilizing these frameworks enables educators to develop mathe-matical tasks that not only assess but also enhance students higher-order thinking abilities and perfor-mance effectively. In general, the objectives of the study are to evaluate student performance in the Statistical Analysis and Software Application course utilizing Blooms and SOLO Taxonomies. Speci-fically, the aims are to:

1. Determine the distribution of student learning outcomes according to the thinking levels outlined in Blooms and SOLO Taxonomies.

2. Align the items of the major examination with the thinking levels delineated in Blooms and SOLO Taxonomies.

3. Determine whether students achieve the antici-pated level of thinking as indicated by the results of major examinations and performance tasks.

METHODOLOGY

This action research utilized a descriptive design incorporating documentary analysis and testing met-hods. The researchers analyzed the approved syllabus for the Mathematics in the Modern World course and aligned the student learning outcomes (SLOs) with the thinking levels outlined in Blooms and SOLO taxo-nomies. The final examination, comprising 50 multiple-choice items with four options each, was employed to assess the attainment of the SLOs. The examination was designed based on the approved table of specifications. A total of 1239 students participated in the study, representing various programs including Engineering (N=818, 66.02%), CAMS (N=47, 3.79%), BSN (N=181, 14.61%), and CTHM (N=193, 15.58%). They undertook the proctored examination simul-taneously for 1.5 hours and were permitted to use mathematical formulas and calculators. Attainment levels were determined using the index of mastery, calculated as the ratio of students who correctly answ-ered a particular item/question to the total number of students who took the test. 

Data analysis was conducted using frequency count and percentage. Test papers and answer sheets were retained by professors/ instructors in accordance with university guidelines for examinations. To ensure confidentiality and anonymity, only test scores and item analytics were retained for subsequent analysis.

RESULTS AND DISCUSSION

Student Learning Outcomes, Blooms and SOLO Taxonomy of Thinking Levels

Table 1 illustrates the distribution of student learning outcomes in the Mathematics in the Modern World course across different thinking levels of the Blooms and SOLO taxonomies. It is noteworthy that the majority of the learning outcomes (N = 18, 68.23%) are situated beyond the comprehension level, targeting application (N = 10, 38.46%), analysis, synthesis, and evaluation (N = 8, 30.77%) levels. This suggests that the course emphasizes higher-order thinking skills in various activities and assessments provided to stud-ents. However, it is observed that the learning out-comes are not evenly distributed across the different levels of the Blooms taxonomy, and not all topics include the development of higher-order thinking skills (Sokhandan A., 2024).

Furthermore, the distribution of student learning out-comes in the course does not adequately cover the various levels of thinking in the SOLO taxonomy. The majority of outcomes target the multi-structural (N = 8, 30.77%) and relational (N = 10, 38.46%) levels. It is observed that certain SOLO levels are not addressed in some course topics. This observation is supported by a study conducted by Saidat et al. (2020), which con-cluded that the SOLO and Blooms models effectively represent students learning outcomes.

Table 1: Distribution of Student Learning Outcomes of the Mathematics in the Modern World Course to the Blooms and SOLO Taxonomy Levels

However, the study also highlighted a direct corre-lation between students performances and their SOLO levels. Additionally, it was suggested that the SOLO and Blooms models could elucidate various develop-mental theories and aid in the development of mathe-matics curricula.

Mapping of Major Examination with the Blooms and SOLO Taxonomy of Thinking Levels

Table 2 Distribution of Test Items/Questions in the Major Examination of Mathematics in the Modern World Course According to Blooms and SOLO Taxo-nomies. Table 2 displays the distribution of test items/ questions in the major examination of the Mathematics in the Modern World course according to Blooms and SOLO Taxonomies. It is evident that certain thinking levels are not assessed in the examination instrument. The majority of items/questions target comprehension (N = 15, 30.00%), application (N = 21, 42.00%), and analysis (N = 14, 28.00%) in the Blooms taxonomy, while multi-structural (N = 17, 34.00%) and relational (N = 33, 66.00%) levels are emphasized in the SOLO taxonomy. However, the assessment instrument used does not provide insight into students performance or attainment in other thinking levels such as knowledge, synthesis, evaluation, uni-structural, and extended abstract. This finding resonates with the studies conducted by Atasoy & Konyalihatipoglu, (2019) and Easdown et al. (2019), who argued that the SOLO model effectively assesses students mathematical understanding across various grade levels. However, it was also noted that the SOLO model may not accu-rately represent students knowledge when multiple-choice questions are utilized, as the responses may contain limited information.

Table 2: Distribution of Major Examination Questions to the Blooms and SOLO Taxonomy of Thinking Levels.

Note: K-Knowledge, C-Comprehension, Ap-Application, An-Analysis, S-Synthesis, E-Evaluation, US-Uni-Structural, MS-Multi-Structural, R-Relational, EA-Extended Abstract

Source: Mathematics Department, Table of Specification for Mathematics in the Modern World, 2022

Students Attainment of the Learning Outcomes

Table 3: Attainment Levels of the Student Learning Outcomes.

Legend: 0.96-1.00 mastered, 0.86-0.95 closely approximating mastery; 0.66-0.85 moving towards mastery, 0.35-0.65 average, 0.15-0.34 low, 0.05-0.14 very low, 0.00-0.14 absolutely no mastery.

CONCLUSION AND RECOMMENDATIONS

Based on the data collected, the researchers drew several conclusions from the study. Firstly, the distri-bution of learning outcomes in Blooms taxonomy appears to be skewed, with a predominant focus on application, analysis, synthesis, and evaluation levels. Conversely, in the SOLO thinking levels, the distri-bution is also uneven, with the majority of outcomes targeting the multi-structural and relational levels, indicating a lack of balance across various cognitive domains. Secondly, upon mapping the items in major examinations, it became evident that the assessment predominantly emphasizes comprehension, appli-cation, and analysis in the Blooms taxonomy, aligning closely with multi-structural and relational levels in the SOLO taxonomy. However, other thinking levels such as knowledge, synthesis, evaluation, uni-struc-tural, and extended abstract are not adequately addressed in the assessment instrument. Lastly, despite satisfactory performance observed in certain learning outcomes, students appear to struggle with attaining the expected level of thinking as measured by the assessment instrument. This limitation in assessment effectiveness is particularly notable in its inability to provide evidence of performance or attainment in the aforementioned thinking levels, potentially hindering a comprehensive evaluation of students mastery of the subject matter. To enhance the instructional delivery of the Mathematics in the Modern World course, several recommendations are proposed. Firstly, a comprehensive review and revision of the course syllabus are essential to ensure an equitable distri-bution of learning out-comes across various thinking levels. This will help address the current imbalance observed in the distribution of outcomes within Blooms taxonomy. Secondly, it is imperative to target different thinking levels within each course topic to promote a more holistic approach to learning. By incorporating activities and assessments that cater to a range of cognitive domains, students will have opportunities to develop their critical thinking skills more effectively. Thirdly, the assessment instruments used, particularly major examinations, should be carefully designed to include questions or items that effectively measure each thinking level. It is crucial to ensure that questions are evenly distributed across all thinking levels to provide a comprehensive evaluation of students understanding and mastery of the subject matter. Lastly, mapping other learning activities and assessment instruments against the various thinking levels is essential to gauge students attainment levels comprehensively.  This will allow instructors to assess the effectiveness of different instructional methods and tailor their teaching strategies accordingly to address any gaps in student understanding across different cognitive domains. Overall, implementing these recommendations will contribute to a more balanced and effective instructional approach in the Mathe-matics in the Modern World course.

ACKNOWLEDGEMENT

The researchers extend their sincere gratitude to Dr. Priscilla Mizpah P. Santillana, Dean of the College of Arts and Sciences, for her invaluable guidance and unwavering support throughout the entirety of the research process. The researchers acknowledge with thanks all individuals who, in any capacity, directly or indirectly, contributed to the completion of this research endeavor.

CONFLICTS OF INTEREST

The authors declare that they have no conflicts of interest related to this research study.

Article References:

  1. Agarwal P. (2019). Blooms taxonomy: Do students need fact knowledge before higher order learning? J. Educ. Psychol, 111(2), 189-209
  2. Atasoy, E., & Konyalihatipoglu, M.  E. (2019). Investigation  of  students  holistic  and  analy-tical thinking  styles  in learning  environments  assisted with  dynamic  geometry software.  Eği-timve Bilim [Education and Science], 44(199), 49-74.  http://doi.org/10.15390/eb.2019.8003   
  3. Care, E., Azim, F., & Cagasan, L.  (2015). Large -scale assessments for use in the Philippines.  http://bit.ly/2G0PvYq   
  4. CHED CMO no. 20, (2013). Mathematics in the Modern World preliminaries. 
  5. Commission on Higher Education, (CHED) Handbook in Typology, Outcomes - Based Edu-cation, and Institutional Sustainability Assess-ment. (2014). 
  6. Commission on Higher Education Memorandum Order NO. 46. Series, (2012). “Policies, Stand-ards, and Guidelines in the Establishment of Outcomes - Based Education (OBE) System in Higher Education Institutions Offering Engine-ering Programs”.  http://ched.gov.ph/cmo-46-s-2012  
  7. Conn, K.  (2017). Identifying effective education interventions in sub-Saharan Africa:  A meta-analysis of impact evaluations. Review of Edu-cational Research, 87(5), 863-898.
  8. Corpuz, B., & Saldanan, G. (2015). Principles of teaching 1. Lorimar Publishing Inc.
  9. Denbel, D, (2015). Students Learning Experi-ences when using a Dynamic Geometry Soft-ware Tool in a Geometry Lesson at Secondary School in Ethiopia. J. of Education and Practice, 6(1). 
  10. DLSU, (2015). Teaching of Mathematics in the Modern World. 
  11. Easdown, D., Papadopoulos, G., & Zheng, C.  (2019). Summer school versus term-time for fun-damental mathematics at the tertiary level.  Inter J. of Innovation in Science and Mathematics Education, 27(5), 13-26.  
  12. Korkmaz, F. & Unsal, S. (2017). Analysis of attainments and evaluation questions in socio-logy curriculum according to the SOLO taxo-nomy. Eurasian J. of Educational Research, 69(2017), 75-92. 
  13. Kusmaryono, I. (2018). Analysis of students incorrect answers in a mathematical test: An insight on students learning based on SOLO taxonomy and error analysis. J. Pengajaran MIPA, 23(1), 1-8. https://doi.org/10.18269/jpmipa.v23i1.9517   
  14. Kusmaryono, I., Suyitno, H., & Dwidayati, N. (2018). Analysis of abstract reasoning from grade 8 students in mathematical problem solving with SOLO Taxonomy guide. Infinity J. of Mathematics Education, 7(2), 69-82. https://doi.org/10.22460/infinity.v7i2.p69-82  
  15. Malik, S. I., Tawafak, R. M., & Shakir, M. (2021). Aligning and assessing teaching app-roaches with SOLO taxonomy in a computer programming course. Inter J. of Information and Communication Technology Education, 17(4). https://doi.org/10.4018/IJICTE.20211001.oa5  
  16. Mindayani, N., Hadi, W., & Ambarita, B. (2019). The development of SOLO taxonomy based assessment tool on text of observation reports of X grade students of senior high school 1 NA. IX-X. Budapest Inter. Research and Critics in Linguistics and Education J., 2(4), 371-381. 
  17. Putri, U., Mardiyana, M., & Saputro, D. (2017). How to analyze the students thinking levels based on SOLO taxonomy? J. of Physics: Con-ference Series, 895, 012031. 
  18. Saidat, A., Baker, P. and Schmude, M. (2020). Structure of the Observed Learning Outcomes (SOLO) model: A mixed-method systematic review of research in mathematics education. Eurasia J. of Mathematics, Science and Tech-nology Education, 18(6). 
  19. Sokhandan A. (2024). Investigating the simul-taneous performance of AI and Blockchain on E-banking transactions, Int. J. Mat. Math. Sci., 6(2), 14-21. https://doi.org/10.34104/ijmms.024.014021  
  20. Valencia, G. R. (2015). CHED panelist seeks release of new college GE syllabus. Retrieved from National Research Council of the Philippines. 

Article Info:

Academic Editor

Dr. Toansakul Tony Santiboon, Professor, Curtin University of Technology, Bentley, Australia.

Received

May 1, 2024

Accepted

May 25, 2024

Published

June 1, 2024

Article DOI: 10.34104/ijmms.024.078084

Corresponding author

Elizabeth Socorro P. Carang*

College of Arts and Sciences, University of Batangas, Philippines.

Cite this article

Ramos RA, Gutierrez MC, Carandang ESP, and Caguete RR. (2024). Measuring student performance in mathematics in the modern world course using Blooms and Solo taxonomies, Int. J. Mat. Math. Sci.6(3), 78-84. https://doi.org/10.34104/ijmms.024.078084

Views
417
Download
115
Citations
Badge Img
Share