Enterprise AI Analysis:
Acceptability Scale for the Use of Large Language Models (LLMs) by Project Teams: Development and Preliminary Validation
This study addresses a critical gap in project management literature by developing and validating a psychometric scale to measure the a priori acceptability of Large Language Models (LLMs) by project teams. Unlike traditional models that focus on post-adoption assessment, this instrument captures pre-adoption judgments, offering a proactive tool for strategic decision-making and governance in AI integration. The final 13-item scale, structured across two correlated factors—Intention/Predisposition and Trust/Perceived Benefit—demonstrates robust psychometric properties and nomological validity, reinforcing acceptability as a multidimensional construct crucial for the effective appropriation of AI in project-oriented organizational systems.
Executive Impact at a Glance
154+
Project Professionals Surveyed
2
Key Acceptability Factors Identified
~0.90 CR
High Composite Reliability
0.06 RMSEA
Excellent Model Fit (CFA)
Deep Analysis & Enterprise Applications
Select a topic to dive deeper, then explore the specific findings from the research, rebuilt as interactive, enterprise-focused modules.
AI in Project Management
Prompt Engineering
Acceptability Construct
AI in Project Management: Enhancing Efficiency and Decision-Making
The integration of AI, particularly LLMs, is reshaping project management. These tools move beyond traditional analytical tasks to support communicative and interpretive activities like drafting proposals, creating work plans, and monitoring teams. This leads to enhanced efficiency, accuracy, and improved decision-making across the project lifecycle.
Prompt Engineering: The Key to LLM Effectiveness
Unlike traditional software, LLMs require users to communicate intent through natural language prompts. Prompt engineering is critical for tailoring LLM outputs to specific task requirements, impacting perceived ease of use and usefulness. Effective prompt design, requiring both linguistic skill and domain knowledge, can significantly enhance model performance and adaptability across diverse project contexts.
Acceptability Construct: A Proactive Approach to Technology Adoption
Acceptability, a core construct, reflects a user's positive mental representation of a tool before actual use, contrasting with acceptance, which is a post-adoption evaluation. This a priori judgment, driven by perceived usefulness and ease of use, is vital for informing strategic decisions and organizational coordination before full technology implementation.
58%
of respondents use LLMs daily/several times a week. This highlights a significant existing engagement but also the potential for broader adoption amongst less frequent users.
Enterprise Process Flow
Initial Diagnosis: Establish baseline acceptability and identify predisposition/trust levels.
→
Team Segmentation: Analyze scores to define tailored implementation strategies.
→
Resource Prioritization: Direct efforts to teams with moderate conversion potential or high strategic impact.
→
Ongoing Monitoring: Periodically reapply the scale to track changes and assess training effectiveness.
| Feature | Acceptability | Acceptance |
|---|---|---|
| Temporal Axis | Prior to effective adoption (a priori) | After actual use (a posteriori) |
| Focus |
|
|
| Measurement | Indirect (via outcome beliefs and behavioral predispositions) | Direct (via usage intention and actual use) |
| Relevance | Strategic decision-making, governance, organizational coordination | Individual adoption decisions, post-implementation assessment |
Case Study: Psychometric Scale for LLM Adoption in Project Teams
The study developed a 13-item psychometric scale to measure LLM acceptability in project management. Through extensive validation (EFA and CFA) on a sample of 154 professionals, the scale revealed a bidimensional structure: Intention/Predisposition and Trust/Perceived Benefit. Both factors demonstrated high internal consistency and good statistical fit, with a moderate correlation (r=0.504), confirming they are distinct yet related. This scale provides a robust tool for organizations to proactively assess readiness for AI integration.
Calculate Your Potential LLM ROI
Estimate the annual savings and hours reclaimed by implementing LLMs in your project management operations. Adjust the parameters to see your potential impact.
Estimated Annual Savings
$0
Annual Hours Reclaimed
0
Your LLM Implementation Roadmap
A structured approach for successful integration of Large Language Models into your enterprise project management. Based on the validated scale, this framework guides you from initial diagnosis to ongoing optimization.
Phase 01: Acceptability Assessment & Baseline
Administer the LLM Acceptability Scale to project teams to gather baseline data on Intention/Predisposition and Trust/Perceived Benefit. Identify areas of high and low readiness.
Phase 02: Targeted Training & Awareness
Develop customized training programs focusing on prompt engineering for low-trust teams and demonstrating clear benefits for low-predisposition teams. Address skepticism with empirical evidence.
Phase 03: Pilot Programs & Early Adopter Engagement
Launch controlled pilot projects with high-acceptability teams to refine usage policies and gather feedback. Leverage early adopters as internal champions for wider adoption.
Phase 04: Governance & Integration
Establish clear governance frameworks for LLM use, including ethical guidelines and data security protocols. Integrate LLMs into existing project management workflows and tools.
Phase 05: Continuous Monitoring & Optimization
Periodically reassess LLM acceptability using the scale to track progress. Adapt strategies, refine training, and optimize usage based on ongoing feedback and performance metrics.
Ready to Transform Your Project Management with AI?
Leverage cutting-edge research to strategically integrate Large Language Models. Our experts are ready to guide you through assessing team acceptability, developing custom implementation plans, and maximizing your ROI.
Ready to Get Started?
Book Your Free Consultation.
Let's Discuss Your AI Strategy!
Lets Discuss Your Needs
Select a Date
Sun
Mon
Tue
Wed
Thu
Fri
Sat