Aids to Beautification, 1983, 9 pages
Kayser shows that adorning ourselves for the purpose of beauty, while it can be abused, is good, intended of God and Biblical. The short article has specific regard to Jewelry, Cosmetics and Perfume.
Armed Resistance to Tyranny: The Biblical Mandate and Limits from the Life of David, 1995, 12 pages, outline notes
This is the most Biblically detailed short exposition of lawful resistance to tyranny available
Church Membership: Is it Biblical? A Brief Study of the Concept of Church Rolls, PDF, 1993, 7 pages
Kayser demonstrates the Biblical obligation of church membership
Glory and Coverings: a Study of 1 Corinthians 11:1-16, PDF, 2003, 52 pages
Kayser convincingly argues that 1 Corinthians 11 teaches that women are to wear head-coverings in the public worship of God
“Has God Indeed Said?”: The Preservation of the Text of the New Testament, PDF, 2004, 35 pages, with Wilbur Pickering. Kayser wrote the first two sections, Pickering the third section
What Greek texts of the New Testament are most faithful to the originals? There are two main views: The Majority Texts and the Critical Texts. Kayser and Pickering here demonstrates the superiority of the Majority Texts
Kayser shows that faithful attendance at public worship is a Biblical obligation
Seven Biblical Principles that Call for Infant Baptism, PDF, 1990, 52 pages
Sunday as a First-Day Sabbath, PDF, 1995, 51 pages
This is the fullest treatment of the change of the Sabbath from the seventh day of the week to the first day of the week.
Torture: a Biblical Critique, PDF, 2010, 22 pages
Kayser demonstrates that torture is contrary to numerous principles in scripture