Algorithmic Counter-Authority and the Epistemic Legitimacy of Large Language Model Advice: Gendered Power in Pakistan as a Philosophical Test Case

Document Type : Research Paper

Authors

1 PhD Candidate in English Language and Literature, College of International Studies, Southwest University, China

2 Professor of English and American Literature, College of International Studies, Southwest University, Chongqing 400715, China.

Abstract

Large language models no longer only supply information; they increasingly render advice, weighing considerations and favoring one course of action, thereby making an implicit claim to some standing to counsel at all. This article treats that shift as a philosophical problem. It develops algorithmic counter-authority to describe how AI-generated responses can limit, reinterpret, or displace an established claim to gendered authority through the reasons they give and the sources they invoke. The concept is developed through close analysis of four AI-generated responses to dilemmas drawn from Pakistani family life: a father's claim over a daughter's university education, a husband's claim to end his wife's postgraduate study, and a father's and brothers' claim to restrict a woman's public employment. These cases serve as philosophical test material, not an empirical sample of provider behavior, and no claim below concerns how any system typically behaves. The central argument is that a system can perform counter-authority convincingly while lacking the epistemic and moral standing ordinarily expected of an adviser: situated knowledge, relational accountability, first-person understanding, recognized religious credential, and accountability for what follows from its counsel. This produces a paradox distinctive to artificial advice-giving: an output can be emancipatory in content while remaining structurally unaccountable in its delivery. Contributing to debates on AI epistemology, artificial moral agency, alignment, and technological power, the article shows that rhetorical confidence did not reliably track evidentiary adequacy across the cases and asks whether this deficit is unique to artificial systems or only intensified and concealed by them.

Keywords

Main Subjects

References

Abdulhai, M., Serapio-García, G., Crepy, C., Valter, D., Canny, J., & Jaques, N. (2024). Moral foundations of large language models. In Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing (pp. 17737–17752). Association for Computational Linguistics. https://doi.org/10.18653/v1/2024.emnlp-main.982
Agence France-Presse. (2024, September 8). Women ride Pakistan's economic crisis into the workplace. Arab News. https://www.arabnews.com/node/2570531/pakistan
Agha, N. (2021). Kinship, patriarchal structure and women's bargaining with patriarchy in rural Sindh, Pakistan. Palgrave Macmillan. https://doi.org/10.1007/978-981-16-6859-3
Aksoy, M. (2025). Whose morality do they speak? Unraveling cultural bias in multilingual language models. Natural Language Processing Journal, 12, Article 100172. https://doi.org/10.1016/j.nlp.2025.100172
Al-Sharmani, M. (2013). Reflections on some Islamic feminist readings of Islamic jurisprudence and their significance in the Egyptian context. In O. Abou-Bakr (Ed.), Feminist & Islamic perspectives: New horizons of knowledge and reform (pp. 136–149). The Women and Memory Forum.
Barlas, A. (2019). Believing women in Islam: Unreading patriarchal interpretations of the Qur'an (Rev. ed.). University of Texas Press. https://doi.org/10.7560/9781477315934
Campbell, H. A. (2007). Who's got the power? Religious authority and the Internet. Journal of Computer-Mediated Communication, 12(3), 1043–1062. https://doi.org/10.1111/j.1083-6101.2007.00362.x
Cheong, P. H. (2017). The vitality of new media and religion: Communicative perspectives, practices, and changing authority in spiritual organization. New Media & Society, 19(1), 25–33. https://doi.org/10.1177/1461444816649913
Cheong, P. H. (2021). Bounded religious automation at work: Communicating human authority in Artificial Intelligence networks. Journal of Communication Inquiry, 45(1), 5–23. https://doi.org/10.1177/0196859920977133
Danaher, J. (2016). The threat of algocracy: Reality, resistance and accommodation. Philosophy & Technology, 29(3), 245–268. https://doi.org/10.1007/s13347-015-0211-1
Dietvorst, B. J., Simmons, J. P., & Massey, C. (2015). Algorithm aversion: People erroneously avoid algorithms after seeing them err. Journal of Experimental Psychology: General, 144(1), 114–126. https://doi.org/10.1037/xge0000033
Floridi, L., & Sanders, J. W. (2004). On the morality of artificial agents. Minds and Machines, 14(3), 349–379. https://doi.org/10.1023/B:MIND.0000035461.63578.9d
Foucault, M. (1991a). Governmentality. In G. Burchell, C. Gordon, & P. Miller (Eds.), The Foucault effect: Studies in governmentality (pp. 87–104). University of Chicago Press.
Foucault, M. (1991b). Questions of method. In G. Burchell, C. Gordon, & P. Miller (Eds.), The Foucault effect: Studies in governmentality (pp. 73–86). University of Chicago Press.
Freeman, G. R. (2025). The legitimacy gap in AI knowledge systems: Epistemic ordering, action stability, and the limits of truth-first governance. PhilArchive. https://philarchive.org/rec/FRETLG
Fricker, M. (2007). Epistemic injustice: Power and the ethics of knowing. Oxford University Press.
Gabriel, I. (2020). Artificial intelligence, values, and alignment. Minds and Machines, 30(3), 411–437. https://doi.org/10.1007/s11023-020-09539-2
Husna, J., & Ibrahim, I. (2025). Epistemic authority and legitimacy in the age of generative AI: A normative framework for evaluating AI as a knowledge-formatter in scientific inquiry. International Journal of Progressive Sciences and Technologies, 55(1), 33–41. https://doi.org/10.52155/ijpsat.v55.1.7673
Kandiyoti, D. (1988). Bargaining with patriarchy. Gender & Society, 2(3), 274–290. https://doi.org/10.1177/089124388002003004
Khan, M. S., & Biao, Z. (2025). Patriarchal bargains and intergenerational negotiations: An exploration of family decision-making for girls' education in Khyber Pakhtunkhwa, Pakistan. Education as Change, 29, 1–21. https://doi.org/10.25159/1947-9417/19649
Khurshid, A., & Leyava, E. (2019). Arranged empowerment versus empowering arrangements: Narratives of Muslim women teachers from Pakistani rural communities. Teachers College Record, 121(13), 1–20. https://doi.org/10.1177/016146811912101308
Logg, J. M., Minson, J. A., & Moore, D. A. (2019). Algorithm appreciation: People prefer algorithmic to human judgment. Organizational Behavior and Human Decision Processes, 151, 90–103. https://doi.org/10.1016/j.obhdp.2018.12.005
Lustig, C., & Nardi, B. (2015). Algorithmic authority: The case of Bitcoin. In 2015 48th Hawaii International Conference on System Sciences (pp. 743–752). IEEE. https://doi.org/10.1109/HICSS.2015.95
Matthias, A. (2004). The responsibility gap: Ascribing responsibility for the actions of learning automata. Ethics and Information Technology, 6(3), 175–183. https://doi.org/10.1007/s10676-004-3422-1
Minardi, A. L., Akmal, M., Crawfurd, L., & Hares, S. (2021). Promoting gender equality in Pakistan means tackling both real and misperceived gender norms. Center for Global Development.
Mir-Hosseini, Z. (2006). Muslim women's quest for equality: Between Islamic law and feminism. Critical Inquiry, 32(2), 629–645.
Moghadam, V. M. (1992). Patriarchy and the politics of gender in modernising societies: Iran, Pakistan and Afghanistan. International Sociology, 7(1), 35–53. https://doi.org/10.1177/026858092007001002
Purewal, N., & Hashmi, N. (2015). Between returns and respectability: Parental attitudes towards girls' education in rural Punjab, Pakistan. British Journal of Sociology of Education, 36(7), 977–995. https://doi.org/10.1080/01425692.2014.883274
Ramezani, A., & Xu, Y. (2023). Knowledge of cultural moral norms in large language models. In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (pp. 428–446). Association for Computational Linguistics. https://doi.org/10.18653/v1/2023.acl-long.26
Rouvroy, A., & Berns, T. (2013). Algorithmic governmentality and prospects of emancipation: Disparateness as a precondition for individuation through relationships? (E. Libbrecht, Trans.). Réseaux, 177(1), 163–196. https://doi.org/10.3917/res.177.0163
Rubab, I., Salahuddin, A., Siddiqui, A., & Javed, N. (2026). Gendered household decision-making in Lahore: Different contextual interpretations of qawwam in Qur'anic verse 4:34. Feminist Theology, 34(2), 154–168. https://doi.org/10.1177/09667350251391785
Santurkar, S., Durmus, E., Ladhak, F., Lee, C., Liang, P., & Hashimoto, T. (2023). Whose opinions do language models reflect? In Proceedings of the 40th International Conference on Machine Learning (Vol. 202, pp. 29971–30004). PMLR.
Shabbir, S. (2025, May 30). Pakistan criminalizes child marriages in Islamabad despite opposition from Council of Islamic Ideology. Arab News. https://www.arabnews.com/node/2602743/amp
Shanahan, M. (2024). Talking about large language models. Communications of the ACM, 67(2), 68–79. https://doi.org/10.1145/3624724
Wadud, A. (1999). Qur'an and woman: Rereading the sacred text from a woman's perspective (2nd ed.). Oxford University Press.
Weber, M. (2019). Economy and society: A new translation (K. Tribe, Ed. & Trans.). Harvard University Press.
World Bank. (2024). Labor force participation rate, female (% of female population ages 15+) (modeled ILO estimate)—Pakistan [Data set]. World Bank Open Data.
World Economic Forum. (2025). Global Gender Gap Report 2025. https://www.weforum.org/publications/global-gender-gap-report-2025/
Zamani, S. S. (2025). Knowledge without a subject: A philosophical reflection on the epistemic legitimacy of the machine. Journal of Philosophical Investigations. Advance online publication. https://doi.org/10.22034/jpiut.2025.70752.4379
Zewail, A., Figueroa, A., Graham, J., & Atari, M. (2026). Moral stereotyping in large language models. Proceedings of the National Academy of Sciences, 123(10), e2519941123. https://doi.org/10.1073/pnas.2519941123
Zulfiqar, A., & Kuskoff, E. (2024). Developing a contextual understanding of empowerment through education: Narratives from highly educated wom en in Pakistan. Gender and Education, 36, 665–681.
Send comment about this article
CAPTCHA Image
Journal of Philosophical Investigations
Volume 20, Issue 56 - Serial Number 56
Articles
October 2026
Pages 337-356

Files

Share

How to cite

Statistics