Aids to Beautification, 1983, 9 pages
Kayser shows that adorning ourselves for the purpose of beauty, while it can be abused, is good, intended of God and Biblical. The short article has specific regard to Jewelry, Cosmetics and Perfume.
Armed Resistance to Tyranny: The Biblical Mandate and Limits from the Life of David, 1995, 12 pages, outline notes
This is the most Biblically detailed short exposition of lawful resistance to tyranny available
The Canon of Scripture: A Presuppositional Study
Conception Control: Avoiding Antinomianism and Legalism
Church Membership: Is it Biblical? A Brief Study of the Concept of Church Rolls, 1993 7 pp.
Kayser demonstrates the Biblical obligation of church membership
Glory and Coverings: a Study of 1 Corinthians 11:1-16 2003 52 pp.
Kayser convincingly argues that 1 Corinthians 11 teaches that women are to wear head-coverings in the public worship of God
“Has God Indeed Said?”: The Preservation of the Text of the New Testament 2004 35 pp. with Wilbur Pickering. Kayser wrote the first two sections, Pickering the third section
What Greek texts of the New Testament are most faithful to the originals? There are two main views: The Majority Texts and the Critical Texts. Kayser and Pickering here demonstrates the superiority of the Majority Texts
Public Assembly: The Biblical Call to Faithful Attendance at Public Worship 2005 14 pp.
Kayser shows that faithful attendance at public worship is a Biblical obligation
Ransom Paid: Does the Bible Limit the Atonement? 1996
Seven Biblical Principles that Call for Infant Baptism 1990 52 pp.
Sunday as a First-Day Sabbath 1995 51 pp.
This is the fullest treatment of the change of the Sabbath from the seventh day of the week to the first day of the week.
Torture: a Biblical Critique 2010 22 pp.
Kayser demonstrates that torture is contrary to numerous principles in scripture