Time estimate: 45 min.

4.13.3. Activity 3: Better Keyword Detection¶

This activity introduces you to some new String methods including some that are not on the exam, but are useful. Your teacher will tell you whether your class is doing this activity or not.

4.13.3.1. More String Methods¶

Run the StringExplorer below. It currently has code to illustrate the use of the indexOf and toLowerCase methods. Do they do what you thought they would? The method indexOf is on the exam and the method toLowerCase is not. Why do you think you might want to change the string to all lowercase characters? Why doesn’t the value of sample change?

Run the code below. Why do you think you might want to change the string to all lowercase characters? Why doesn’t the value of sample change? Do string methods change the string? Try some other string methods.

/**
 * A program to allow students to try out different String methods.
 *
 * @author Laurie White
 * @version April 2012
 */
public class StringExplorer
{

public static void main(String[] args)
    {
        String sample = "The quick brown fox jumped over the lazy dog.";

//  Demonstrate the indexOf method.
        int position = sample.indexOf("quick");
        System.out.println("sample.indexOf(\"quick\") = " + position);

//  Demonstrate the toLowerCase method.
        String lowerCase = sample.toLowerCase();
        System.out.println("sample.toLowerCase() = " + lowerCase);
        System.out.println("After toLowerCase(), sample = " + sample);

//  Try other methods here:

}
}

====
// should pass if/when they run code
import static org.junit.Assert.*;

import org.junit.*;

import java.io.*;

public class RunestoneTests extends CodeTestHelper
{
    @Test
    public void testMain() throws IOException
    {
        String output = getMethodOutput("main");
        String expect = "sample.indexOf(\"quick\") = 4\n...";
        boolean passed = getResults(expect, output, "Expected output from main", true);
        assertTrue(passed);
    }
}

Open the API for String in Java documentation| in another tab. Scroll down to the Method Summary section and find the indexOf(String str) method. Follow the link and read the description of the indexOf method.

Copy the following lines to StringExplorer in the ActiveCode above in the main method above to see for yourself that indexOf behaves as specified:

int notFoundPsn = sample.indexOf("slow");
System.out.println("sample.indexOf(\"slow\") = " + notFoundPsn);

Read the description of indexOf(String str, int fromIndex). Add lines to StringExplorer that illustrate how this version of indexOf differs from the one with one parameter.

4.13.3.2. Better Keyword Detection¶

In activity 2, you discovered that simply searching for collections of letters in a string does not always work as intended. For example, the word “cat” is in the string “Let’s play catch!”, but the string has nothing to do with the animal. In this activity, you will trace a method that searches for a full word in the string. It will check the substring before and after the string to ensure that the keyword is actually found.

Take a look at the findKeyword method below. It has a while loop in it which we haven’t seen before. A while loop repeats the code in the block below it while a condition is true. A block is all the code inside of an open curly brace { and a close curly brace }.

private int findKeyword(String statement, String goal,
        int startPos)
{
   String phrase = statement.trim();
   // The only change to incorporate the startPos is in
   // the line below
   int psn = phrase.toLowerCase().indexOf(goal.toLowerCase(),
                                          startPos);

   // Refinement--make sure the goal isn't part of a word
   while (psn >= 0)
   {
      // Find the string of length 1 before and after
      // the word
      String before = " ", after = " ";
      if (psn > 0)
      {
         before = phrase.substring(psn - 1, psn).toLowerCase();
      }
      if (psn + goal.length() < phrase.length())
      {
         after = phrase.substring(
                  psn + goal.length(),
                  psn + goal.length() + 1)
                  .toLowerCase();
      }

      /* determine the values of psn, before, and after at this point */

      // If before and after aren't letters, we've
      // found the word
      if (((before.compareTo("a") < 0) ||
           (before.compareTo("z") > 0)) // before is not a letter
          && ((after.compareTo("a") < 0) ||
              (after.compareTo("z") > 0)))
      {
          return psn;
      }

      // The last position didn't work, so let's find
      // the next, if there is one.
      psn = phrase.indexOf(goal.toLowerCase(),psn + 1);

   }

   return -1;
}

Run the code below or this replit.com version 3 to see this new method findKeyword in action. It is called from the getResponse method to print out an appropriate response based on a keyword. For example, looking for the word "no" to print out "Why so negative?", but it won’t match no inside of another word like "another".

if (findKeyword(statement, "no") >= 0)
{
   response = "Why so negative?";
}

You can also step through the code in the Java visualizer or using the CodeLens button below. It may take a minute or two to load. Click the forward button at the bottom of the code to execute the next statement.

Modify the code below to print the values of psn, before, and after right after the comment on line 100 in the findKeyword method below. Record each of the values in a table. The College Board student guide for the Magpie Chatbot Lab has a table on page 8 that can be printed. Use the CodeLens button to step through the code.

/**
 * A program to carry on conversations with a human user. This version:
 *
 * <ul>
 *   <li>Uses advanced search for keywords
 * </ul>
 *
 * @author Laurie White
 * @version April 2012
 */
public class Magpie3
{
    /**
     * Get a default greeting
     *
     * @return a greeting
     */
    public String getGreeting()
    {
        return "Hello, let's talk.";
    }

/**
     * Gives a response to a user statement
     *
     * @param statement the user statement
     * @return a response based on the rules given
     */
    public String getResponse(String statement)
    {
        String response = "";
        if (statement.length() == 0)
        {
            response = "Say something, please.";
        }
        else if (findKeyword(statement, "no") >= 0)
        {
            response = "Why so negative?";
        } else if (findKeyword(statement, "mother") >= 0
                || findKeyword(statement, "father") >= 0
                || findKeyword(statement, "sister") >= 0
                || findKeyword(statement, "brother") >= 0)
        {
            response = "Tell me more about your family.";
        }
        else
        {
            response = getRandomResponse();
        }
        return response;
    }

/**
     * Search for one word in phrase. The search is not case sensitive. This method
     * will check that the given goal is not a substring of a longer string (so,
     * for example, "I know" does not contain "no").
     *
     * @param statement the string to search
     * @param goal the string to search for
     * @param startPos the character of the string to begin the search at
     * @return the index of the first occurrence of goal in statement or -1 if it's
     *     not found
     */
    private int findKeyword(String statement, String goal, int startPos)
    {
        String phrase = statement.trim();
        // The only change to incorporate the startPos is in
        // the line below
        int psn = phrase.toLowerCase().indexOf(goal.toLowerCase(), startPos);

// Refinement--make sure the goal isn't part of a
        // word
        while (psn >= 0)
        {
            // Find the string of length 1 before and after
            // the word
            String before = " ", after = " ";
            if (psn > 0)
            {
                before = phrase.substring(psn - 1, psn).toLowerCase();
            }
            if (psn + goal.length() < phrase.length())
            {
                after =
                        phrase.substring(
                                        psn + goal.length(),
                                        psn + goal.length() + 1)
                                .toLowerCase();
            }

/* determine the values of psn, before, and after at this point */

// If before and after aren't letters, we've
            // found the word
            if (((before.compareTo("a") < 0)
                            || (before.compareTo("z") > 0)) // before is not a
                    // letter
                    && ((after.compareTo("a") < 0)
                            || (after.compareTo("z") > 0)))
            {
                return psn;
            }

// The last position didn't work, so let's find
            // the next, if there is one.
            psn = phrase.indexOf(goal.toLowerCase(), psn + 1);
        }

return -1;
    }

/**
     * Search for one word in phrase. The search is not case sensitive. This method
     * will check that the given goal is not a substring of a longer string (so,
     * for example, "I know" does not contain "no"). The search begins at the
     * beginning of the string.
     *
     * @param statement the string to search
     * @param goal the string to search for
     * @return the index of the first occurrence of goal in statement or -1 if it's
     *     not found
     */
    private int findKeyword(String statement, String goal)
    {
        return findKeyword(statement, goal, 0);
    }

/**
     * Pick a default response to use if nothing else fits.
     *
     * @return a non-committal string
     */
    private String getRandomResponse()
    {
        final int NUMBER_OF_RESPONSES = 4;
        double r = Math.random();
        int whichResponse = (int) (r * NUMBER_OF_RESPONSES);
        String response = "";

if (whichResponse == 0)
        {
            response = "Interesting, tell me more.";
        }
        else if (whichResponse == 1)
        {
            response = "Hmmm.";
        }
        else if (whichResponse == 2)
        {
            response = "Do you really think so?";
        }
        else if (whichResponse == 3)
        {
            response = "You don't say.";
        }

return response;
    }

public static void main(String[] args)
    {
        Magpie3 maggie = new Magpie3();

maggie.findKeyword("yesterday is today's day before.", "day", 0);
    }
}

====
// should pass if/when they run code
import static org.junit.Assert.*;

import org.junit.*;

import java.io.*;

public class RunestoneTests extends CodeTestHelper
{
    @Test
    public void testMain() throws IOException
    {
        String output = getMethodOutput("main");
        String expect = "6...";
        boolean passed = getResults(expect, output, "Expected output from main", true);
        assertTrue(passed);
    }
}

4.13.3.3. Exercise: Use the new method¶

Repeat the changes you made to the program in Activity 2, using this new method to detect keywords. You can use the active code window above, or the replit.com version 3 or your own IDE.

4.13.3.4. Questions: Prepare for the next activity¶

Single keywords are interesting, but better chatbots look for groups of words. Consider statements like “I like cats,” “I like math class,” and “I like Spain.” All of these have the form “I like something.” The response could be “What do you like about something?” The next activity will expand on these groups. You will get to add one of your own, so it’s a good idea to start paying close attention to common phrases in your own conversations.

You have attempted of activities on this page