Using natural language processing to analyze elementary teachers’ mathematical pedagogical content knowledge in online community of practice

Jiseung Yoo; Min Kyeong Kim

doi:10.30935/cedtech/13278

Jiseung Yoo ¹, Min Kyeong Kim ¹ ^*

More Detail

CONT ED TECHNOLOGY, Volume 15, Issue 3, Article No: ep438

https://doi.org/10.30935/cedtech/13278

Submitted: 03 March 2023, Published Online: 15 May 2023

OPEN ACCESS 693 Views 439 Downloads

Download Full Text (PDF)

Abstract

This study focuses on how teachers’ pedagogical content knowledge (PCK) of mathematics may differ depending on teacher interactions in an online teacher community of practice (CoP). The study utilizes data from 26,857 posts collected from the South Korean self-generated online teacher CoP, ‘Indischool’. This data was then analyzed using natural language processing techniques; specifically, text classification with word2vec, BERT, and machine learning classifiers was used. The results indicate that the texts of posts can predict the level of teacher interactions in the online CoP. BERT embedding and classifier exhibited the best performance, ultimately achieving an F1 score of .756. Moreover, topic modeling utilizing BERT embedding is used to uncover the specific PCK of teachers through high- and low-interaction posts. The results reveal that high-interaction posts with numerous likes and replies demonstrate more in-depth reflections on teaching mathematics and refined PCK. This study makes two significant contributions. First, it applies a data science framework that allows for the analysis of real data from an actual online teacher community. Secondly, it sheds light on the intricacies of knowledge management in an online teacher CoP, an area that has to this point received limited empirical attention.

Keywords: online community of practice, natural language processing, mathematics pedagogical content knowledge, knowledge management

References

Ball, D. L., & Bass, H. (2003). Toward a practice-based theory of mathematical knowledge for teaching. In B. Davis, & E. Simmt (Eds.), Proceedings of the 2002 Annual Meeting of the Canadian Mathematics Education Study Group (pp. 3-14).
Ball, D. L., Thames, M. H., & Phelps, G. (2008). Content knowledge for teaching: What makes it special? Journal of Teacher Education, 59(5), 389-407. https://doi.org/10.1177/0022487108324554
Barab, S. A., MaKinster, J. G., & Scheckler, R. (2003). Designing system dualities: Characterizing a web-supported professional development community. The Information Society, 19(3), 237-256. https://doi.org/10.1080/01972240309466
Barker, R. (2015). Management of knowledge creation and sharing to create virtual knowledge-sharing communities: A tracking study. Journal of Knowledge Management, 19, 334-350. https://doi.org/10.1108/JKM-06-2014-0229
Bergviken-Rensfeldt, A., Hillman, T., & Selwyn, N. (2018). Teachers ‘liking’ their work? Exploring the realities of teacher Facebook groups. British Educational Research Journal, 44(2), 230-250. https://doi.org/10.1002/berj.3325
Booth, S. E. (2012). Cultivating knowledge sharing and trust in online communities for educators. Journal of Educational Computing Research, 47(1), 1-31. https://doi.org/10.2190/EC.47.1.a
Bozkurt, A., Koutropoulos, A., Singh, L., & Honeychurch, S. (2020). On lurking: Multiple perspectives on lurking within an educational community. The Internet and Higher Education, 44, 100709. https://doi.org/10.1016/j.iheduc.2019.100709
Brown, R., & Munger, K. (2010). Learning together in cyberspace: Collaborative dialogue in a virtual network of educators. Journal of Technology and Teacher Education, 18(4), 541-571.
Burkink, T. (2002). Cooperative and voluntary wholesale groups: Channel coordination and interfirm knowledge transfer. Supply Chain Management: An International Journal, 7(2), 60-70. https://doi.org/10.1108/13598540210425812
Davenport, E. (2001). Knowledge management issues for online organizations: ‘Communities of practice’ as an exploratory framework. Journal of Documentation, 57(1), 61-75. https://doi.org/10.1108/EUM0000000007077
Davis, T. (2013). Building and using a personal/professional learning network with social media. The Journal of Research in Business Education, 55(1), 1-13.
Dibie, O., & Sumner, T. (2016). Using weak ties to understand the resource usage and sharing patterns of a professional learning community. Social Network Analysis and Mining, 6(1), 6-27. https://doi.org/10.1007/s13278-016-0335-z
Faraj, S., Jarvenpaa, S. L., & Majchrzak, A. (2011). Knowledge collaboration in online communities. Organization Science, 22(5), 1224-1239. https://doi.org/10.1287/orsc.1100.0614
Faraj, S., Kudaravalli, S., & Wasko, M. (2015). Leading collaboration in online communities. MIS Quarterly, 39(2), 393-412. https://doi.org/10.25300/MISQ/2015/39.2.06
Fesenmaier, J., & Contractor, N. (2001). The evolution of knowledge networks: An example for rural development. Community Development, 32(1), 160-175. https://doi.org/10.1080/15575330109489697
Gao, F., Luo, T., & Zhang, K. (2012). Tweeting for learning: A critical analysis of research on microblogging in education published in 2008-2011. British Journal of Educational Technology, 43(5), 783-801. https://doi.org/10.1111/j.1467-8535.2012.01357.x
Goodyear, V. A., Casey, A., & Kirk, D. (2014). Tweet me, message me, like me: Using social media to facilitate pedagogical change within an emerging community of practice. Sport, Education and Society, 19(7), 927-943. https://doi.org/10.1080/13573322.2013.858624
Greenhow, C., Galvin, S. M., Brandon, D. L., & Askari, E. (2020). A decade of research on K–12 teaching and teacher learning with social media: Insights on the state of the field. Teachers College Record, 122(6), 1-72. https://doi.org/10.1177/016146812012200602
Grootendorst, M. (2022). BERTopic: Neural topic modeling with a class-based TF-IDF procedure. arXiv, 05794. https://doi.org/10.48550/arXiv.2203.05794
Grossman, P. L. (1989). A study in contrast: Sources of pedagogical content knowledge for secondary English. Journal of Teacher Education, 40(5), 24-31. https://doi.org/10.1177/002248718904000504
Hansen, M. T. (1999). The search-transfer problem: The role of weak ties in sharing knowledge across organization subunits. Administrative Science Quarterly, 44(1), 82-111. https://doi.org/10.2307/2667032
Hara, N., & Kling, R. (2002). Communities of practice with and without information technology. In E. G. Toms (Ed.), Proceedings of the 65^th American Society for Information Science and Technology Annual Meeting (pp. 338-349). Information Today. https://doi.org/10.1002/meet.1450390137
Hill, H. C., Sleep, L., Lewis, J. M., & Ball, D. L. (2007). Assessing teachers’ mathematical knowledge: What knowledge matters and what evidence counts? In F. Lester (Ed.), Second handbook of research on mathematics teaching and learning (pp. 111-156). Information Age Publishing.
Hillman, T., Lundin, M., Rensfeldt, A. B., Lantz-Andersson, A., & Peterson, L. (2021). Moderating professional learning on social media: A balance between monitoring, facilitation and expert membership. Computers & Education, 168, 104191. https://doi.org/10.1016/j.compedu.2021.104191
Hu, S., Torphy, K. T., Opperman, A., Jansen, K., & Lo, Y. J. (2018). What do teachers share within socialized knowledge communities: A case of Pinterest. Journal of Professional Capital and Community, 3(2), 97-122. https://doi.org/10.1108/JPCC-11-2017-0025
Hur, J. W., & Hara, N. (2007). Factors cultivating sustainable online communities for K-12 teacher professional development. Journal of Educational Computing Research, 36(3), 245-268. https://doi.org/10.2190/37H8-7GU7-5704-K470
Indischool. (2022). Indischool statistical data. Brunch. https://brunch.co.kr/@indischool/70
Jin, F., & Wang, Y. (2022). The emergence of community knowledge in a complex network-based folksonomy self-organization mode. In Proceedings of the 11^th International Conference on Software and Information Engineering (pp. 62-65). https://doi.org/10.1145/3571513.3571524
Kim, D. H. (2008). The development process of network-based community of practice for teachers’ knowledge sharing and expertise development: A case study of Indischool. Journal of Educational Technology, 24(2), 1-30. https://doi.org/10.17232/KSET.24.2.1
Kim, H., Hwang, S., Kwak, Y., & Choi, J. (2022). Can online community managers enhance user engagement? Evidence from anonymous social media postings. Knowledge Management Research, 23(2), 211-228. https://doi.org/10.15813/kmr.2022.23.2.011
Krutka, D. G., & Carpenter, J. P. (2016). Participatory learning through social media: How and why social studies educators use Twitter. Contemporary Issues in Technology and Teacher Education, 16(1), 38-59.
Lantz-Andersson, A., Lundin, M., & Selwyn, N. (2018). Twenty years of online teacher communities: A systematic review of formally-organized and informally-developed professional learning groups. Teaching and Teacher Education, 75, 302-315. https://doi.org/10.1016/j.tate.2018.07.008
Lee, D., Jung, J., Shin, S., Otternbreit-Leftwich, A., & Glazewski, K. (2020). A sociological view on designing a sustainable online community for K–12 teachers: A systematic review. Sustainability, 12(22), 9742. https://doi.org/10.3390/su12229742
Leung, J. (2022). An NLP approach for extracting practical knowledge from a CMS-based community of practice in e-learning. Knowledge, 2(2), 310-336. https://doi.org/10.3390/knowledge2020018
Liljekvist, Y. E., Randahl, A. C., van Bommel, J., & Olin-Scheller, C. (2021). Facebook for professional development: Pedagogical content knowledge in the center of teachers’ online communities. Scandinavian Journal of Educational Research, 65(5), 723-735. https://doi.org/10.1080/00313831.2020.1754900
Liu, J., Wei, J., Liu, Y., & Jin, D. (2022). How to channel knowledge coproduction behavior in an online community: Combining machine learning and narrative analysis. Technological Forecasting and Social Change, 183, 121887. https://doi.org/10.1016/j.techfore.2022.121887
Luo, T., Freeman, C., & Stefaniak, J. (2020). “Like, comment, and share”–professional development through social media in higher education: A systematic review. Educational Technology Research and Development, 68(4), 1659-1683. https://doi.org/10.1007/s11423-020-09790-5
Macià, M., & García, I. (2016). Informal online communities and networks as a source of teacher professional development: A review. Teaching and Teacher Education, 55, 291-307. https://doi.org/10.1016/j.tate.2016.01.021
Matranga, A., & Silverman, J. (2020). An emerging community in online mathematics teacher professional development: An interactional perspective. Journal of Mathematics Teacher Education, 25, 63-89. https://doi.org/10.1007/s10857-020-09480-2
Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013). Efficient estimation of word representations in vector space. arXiv, 3781. https://doi.org/10.48550/arXiv.1301.3781
Nonaka, I., & Takeuchi, H. (2007). The knowledge-creating company. Harvard Business Review, 85(7-8), 162.
Peng, G. (2019). Co-membership, networks ties, and knowledge flow: An empirical investigation controlling for alternative mechanisms. Decision Support Systems, 118, 83-90. https://doi.org/10.1016/j.dss.2019.01.005
Rehm, M., & Notten, A. (2016). Twitter as an informal learning space for teachers!? The role of social capital in Twitter conversations among teachers. Teaching and Teacher Education, 60, 215-223. https://doi.org/10.1016/j.tate.2016.08.015
Ryu, K., & Lee, Y. (2017). Effects of online teacher learning community activities linked with internship course for the improvement of elementary pre-service teacher’s TPACK. The Journal of Korean Teacher Education, 34(2), 417-437. https://doi.org/10.24211/tjkte.2017.34.2.417
Schön, D. A. (1990). Educating the reflective practitioner. Jossey-Bass.
Seo, K. (2011). Collaborative professional development of online teacher community. The Journal of Korean Teacher Education, 28(1), 133-161. https://doi.org/10.24211/tjkte.2011.28.1.133
Shahbaznezhad, H., Dolan, R., & Rashidirad, M. (2021). The role of social media content format and platform in users’ engagement behavior. Journal of Interactive Marketing, 53(1), 47-65. https://doi.org/10.1016/j.intmar.2020.05.001
Shulman, L. S. (1987). Knowledge and teaching: Foundations of the new reform. Harvard Educational Review, 57(1), 1-23. https://doi.org/10.17763/haer.57.1.j463w79r56455411
SKT Brain. (2019). Korean BERT pre-trained cased (KoBERT). https://github.com/SKTBrain/KoBERT
Staudt Willet, K. B., & Carpenter, J. P. (2021). A tale of two subreddits: Change and continuity in teaching-related online spaces. British Journal of Educational Technology, 52(2), 714-733. https://doi.org/10.1111/bjet.13051
Trust, T. (2015). Deconstructing an online community of practice: Teachers’ actions in the Edmodo math subject community. Journal of Digital Learning in Teacher Education, 31(2), 73-81. https://doi.org/10.1080/21532974.2015.1011293
Trust, T., Krutka, D. G., & Carpenter, J. P. (2016), “Together we are better”: Professional learning networks for teachers. Computer & Education, 102, 15-34. https://doi.org/10.1080/21532974.2016.1208506
Tseng, F. C., & Kuo, F. Y. (2014). A study of social participation and knowledge sharing in the teachers’ online professional community of practice. Computers & Education, 72, 37-47. https://doi.org/10.1016/j.compedu.2013.10.005
van Bommel, J., Randahl, A. C., Liljekvist, Y., & Ruthven, K. (2020). Tracing teachers’ transformation of knowledge in social media. Teaching and Teacher Education, 87, 102958. https://doi.org/10.1016/j.tate.2019.102958
Wenger, E., Trayner, B., & De Laat, M. (2011). Promoting and assessing value creation in communities and networks: A conceptual framework. Cambridge University Press.
Xie, Q., & Luo, T. (2019). Examining user participation and network structure via an analysis of a Twitter-supported conference backchannel. Journal of Educational Computing Research, 57(5), 1160-1185. https://doi.org/10.1177/0735633118791262
Zöller, N., Morgan, J. H., & Schröder, T. (2020). A topology of groups: What Github can tell us about online collaboration. Technological Forecasting and Social Change, 161, 120291. https://doi.org/10.1177/0735633118791262

Citation

Yoo, J., & Kim, M. K. (2023). Using natural language processing to analyze elementary teachers’ mathematical pedagogical content knowledge in online community of practice. Contemporary Educational Technology, 15(3), ep438. https://doi.org/10.30935/cedtech/13278

Yoo, J., and Kim, M. K. (2023). Using natural language processing to analyze elementary teachers’ mathematical pedagogical content knowledge in online community of practice. Contemporary Educational Technology, 15(3), ep438. https://doi.org/10.30935/cedtech/13278

Yoo J, Kim MK. Using natural language processing to analyze elementary teachers’ mathematical pedagogical content knowledge in online community of practice. CONT ED TECHNOLOGY. 2023;15(3), ep438. https://doi.org/10.30935/cedtech/13278

Yoo, Jiseung, and Min Kyeong Kim. "Using natural language processing to analyze elementary teachers’ mathematical pedagogical content knowledge in online community of practice". Contemporary Educational Technology 2023 15 no. 3 (2023): ep438. https://doi.org/10.30935/cedtech/13278

Yoo, Jiseung et al. "Using natural language processing to analyze elementary teachers’ mathematical pedagogical content knowledge in online community of practice". Contemporary Educational Technology, vol. 15, no. 3, 2023, ep438. https://doi.org/10.30935/cedtech/13278

Yoo J, Kim MK. Using natural language processing to analyze elementary teachers’ mathematical pedagogical content knowledge in online community of practice. CONT ED TECHNOLOGY. 2023;15(3):ep438. https://doi.org/10.30935/cedtech/13278