Can You Trust AI at Work?
|
Question |
Amplify’s Answer |
What the Policy Says |
Your Evaluation |
|---|---|---|---|
|
1. With a best guess, what do you think Western Carolina University IT Division policy says about who is eligible for remote work? |
|
WCU IT remote work would likely depend on the job duties, employee performance, security requirements, and management approval. Positions that require regular on-campus work would be less likely to qualify. |
Partially Accurate |
|
2. With a best guess, who must approve a remote-work arrangement at Western Carolina University? |
The response suggests that the employee’s manager would likely need to approve remote work, with HR possibly being involved as well. |
A remote-work arrangement would likely need approval from the employee’s supervisor, IT or division leadership, and HR. Out-of-state remote work may also require additional executive approval. |
Partially Accurate |
|
3. With a best guess, what responsibilities does a WCU employee have while working remotely? |
Employees working remotely would likely be responsible for staying productive, following IT and security policies, being available during work hours, and completing their normal job duties. |
Remote employees must maintain normal work performance and hours, protect university information, keep a safe workspace, take care of university equipment, and be available to come on campus when required. |
Accurate |
|
4. With a best guess, can a WCU remote-work arrangement be changed or ended? If so, under what circumstances? |
A remote-work arrangement could likely be changed or ended if the employee’s job duties change, performance declines, business needs change, or they no longer meet the requirements. |
Yes. A remote-work arrangement can be changed or ended because of business needs, performance issues, policy violations, job or supervisor changes, or during an annual review. Employees may then be required to return to campus. |
Accurate |
|
5. With a best guess, how does WCU’s remote-work policy compare with North Carolina’s state telework policy? |
WCU’s policy would likely be similar to North Carolina’s telework policy, focusing on approval, security, and employee performance. However, WCU may have more flexibility depending on the department and job role. |
WCU’s remote-work policy would likely be similar to North Carolina’s state telework policy, but WCU can add its own rules and procedures based on the needs of the university and IT department. |
Accurate |
Did the Source Material Make a Difference?
1. Amplify’s answer became more specific after it was given the source material. In the first conversation, it mostly guessed that technical positions would be more likely to qualify for remote work. In the second conversation, it explained that eligibility depends on job duties, performance, attendance, conduct, and management approval. It also clarified that there was no separate WCU IT policy in the documents. This shows that the source material helped Amplify give a more accurate and detailed answer.
2. Amplify’s second answer was much more specific than the first. At first, it only guessed that the employee’s manager would approve remote work. After seeing the policy, it explained that longer arrangements require approval from the supervisor and Division Head, while temporary arrangements can be approved by the supervisor. This shows that the source material helped Amplify give more accurate details.
3. Amplify’s second answer was much more detailed than the first. The first answer only mentioned productivity, security, availability, and completing job duties. After seeing the policy, it included specific responsibilities like attending meetings, protecting university information, maintaining a safe workspace, and reporting changes. This shows that the source material made the answer more specific.
4. Amplify’s second answer was more specific than the first. The first answer only guessed that remote work could end because of performance or job changes. The second answer explained that management decisions, business needs, emergencies, and supervisor changes can also affect the arrangement. It also added that changes should be documented and employees may have to return to campus and return university equipment.
5. Amplify’s second answer was more specific than the first. The first answer only guessed that WCU’s policy would be similar to North Carolina’s. The second answer explained that both policies cover eligibility, performance, safety, location, and management approval, while WCU has more specific university procedures. This shows that the source material helped Amplify make a clearer comparison.
What Does This Mean for AI at Work?
1. Would You Trust the AI?
I would not make a decision about working remotely based only on an AI-generated answer. This experiment showed me that AI can make guesses when it does not have the actual source material. When it was given the policies, its answers became more specific and accurate, but I would still want to check the actual policy before making an important workplace decision.
2. Information vs. Action
There is a difference between an AI having information and being able to take action. An AI can use information to answer questions, but an AI that can take action could actually make changes or complete tasks for someone. This matters in the workplace because mistakes can become more serious when AI can take action without a person checking it first.
3. Where Would You Draw the Line?
I would be comfortable letting AI handle a simple task like organizing information or summarizing documents with little supervision. However, I would want a person to verify something like approving an employee’s remote-work arrangement before anything was done. I would treat these tasks differently because a mistake in a summary is easier to fix, while a mistake involving an employee’s work status could have bigger consequences.
