Evaluation Criteria

How papers will be evaluated for SmartTech 2025

View Criteria Submission Guidelines

The evaluation of submitted papers will follow these four key criteria: contribution significance, originality, technical consistency, and writing quality. Papers that excel in these areas will have a higher chance of acceptance.

Contribution

The evaluation of the paper contribution is the most critical part. Papers with little contributions are likely to be recommended for a reject by the reviewers.

Key Requirements:
  • Submit papers with clear and new contributions to the state-of-the-art
  • Both theoretical and practical contributions are acceptable
  • Clearly enumerate the contributions at the end of the introduction or in the related works section
  • Formulate the research question(s) addressed in the paper
  • Describe your solution and explain why it advances the state of the art

Technical contributions could be related to:

  • Developing new theoretical models
  • Demonstrating practical concepts or tools
  • Deployment experiments
  • Application use cases
  • Successful or failed stories
  • Technology transfer
  • Investigation of open problems

For papers with practical contributions, authors must clearly explain the work being done and provide insights into the lessons learned.

Important:

We strongly encourage researchers to present experimental or simulation evaluations wherever appropriate. These can be achieved using actual implementations, simulations, or data from case studies, tests, or real machine models. The validation of the contribution is as important as the contribution itself. The validation must be applicable in a general context, not just carefully chosen scenarios that favor the proposed approaches.

Originality

Authors must submit original work not published before or not considered for publication elsewhere. They are required to explicitly explain the difference between their contribution and the current state-of-the-art (including their previous work).

Key Requirements:
  • In the related works section, discuss and compare state-of-the-art approaches against your proposal
  • Emphasize the novelty of your presented work
  • Discuss technical limitations of your approaches
  • Provide an unbiased opinion about the advantages and disadvantages of your approach
Warning:

Plagiarism is strictly prohibited, and any serious plagiarism case will be automatically discarded from the conference program without any review.

Technical Consistency

Technical consistency is a mandatory acceptance prerequisite. It's the authors' duty, with whatever means the authors consider appropriate, to persuade examiners of the technical correctness of their article.

Key Requirements:
  • To increase confidence in findings and enhance reusability, we encourage open source projects and computerized proofs
  • Provide all assumptions made in your approach
  • Discuss the implications of these assumptions in the obtained results
  • Describe experimental settings with sufficient detail to allow reproduction of experiments and verification of results

Writing Quality

The quality of writing is of great significance. A paper that is poorly written will likely be rejected by reviewers even if it provides a good contribution.

Key Requirements:
  • Ensure the paper is well structured and written for accurate understanding of technical contributions
  • Update text and reduce typos and grammatical errors
  • Use professional automated tools for proofreading the paper before submission

Acknowledgments: These evaluation criteria are a customized version of the evaluation criteria of SMARTTECH2022.